-- Logs begin at Mon 2022-09-19 14:13:44 UTC, end at Mon 2022-09-19 15:58:42 UTC. -- Sep 19 15:00:28.788496 dv-cinder-756711-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 15:00:28.798770 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 15:00:28 2022] *** Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: nodename: dv-cinder-756711-11-iscsi Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: machine: x86_64 Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: clock source: unix Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: pcre jit disabled Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: detected number of CPU cores: 4 Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: current working directory: / Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: detected binary path: /usr/bin/uwsgi-core Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: your processes number limit is 47680 Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: your memory page size is 4096 bytes Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: detected max file descriptor number: 2048 Sep 19 15:00:28.800177 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: lock engine: pthread robust mutexes Sep 19 15:00:28.803021 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: thunder lock: enabled Sep 19 15:00:28.803021 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 15:00:28.803021 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 15:00:28.841110 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: Python main interpreter initialized at 0x56365af909c0 Sep 19 15:00:28.841110 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: python threads support enabled Sep 19 15:00:28.841110 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: your server socket listen backlog is limited to 100 connections Sep 19 15:00:28.841110 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: your mercy for graceful operations on workers is 90 seconds Sep 19 15:00:28.841525 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 15:00:28.841525 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: *** Operational MODE: preforking *** Sep 19 15:00:28.841840 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: *** uWSGI is running in multiple interpreter mode *** Sep 19 15:00:28.841840 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: spawned uWSGI master process (pid: 106140) Sep 19 15:00:28.841991 dv-cinder-756711-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 15:00:28.850813 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: spawned uWSGI worker 1 (pid: 106141, cores: 1) Sep 19 15:00:28.850813 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: spawned uWSGI worker 2 (pid: 106142, cores: 1) Sep 19 15:00:28.850813 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 15:00:29.506631 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 15:00:29.511127 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 15:00:30.611961 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:00:30.611961 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: from cryptography.utils import int_from_bytes Sep 19 15:00:30.612616 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:00:30.612616 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: from cryptography.utils import int_from_bytes Sep 19 15:00:30.617094 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:00:30.617094 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: from cryptography.utils import int_from_bytes Sep 19 15:00:30.617515 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:00:30.617515 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: from cryptography.utils import int_from_bytes Sep 19 15:00:33.144782 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 15:00:33.145345 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 15:00:33.145550 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 15:00:33.145913 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 15:00:33.146171 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 15:00:33.146561 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.146892 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.147241 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.147566 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.147898 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.148211 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.148553 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.148874 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.148972 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 15:00:33.149336 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 15:00:33.149416 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.149504 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.149661 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 15:00:33.149750 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.150021 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 15:00:33.150115 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756711-11-iscsi {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.150278 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 15:00:33.150394 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.150667 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.150763 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.150975 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.151084 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.151296 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.151406 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.151597 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.151691 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.151918 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.152003 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.152266 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.152358 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.152806 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.152925 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.153939 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154085 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154191 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154323 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154496 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154496 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154730 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154730 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.154936 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756711-11-iscsi {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155061 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155153 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155233 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155324 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155412 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155498 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155662 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155753 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.155961 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.156056 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.156280 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.156419 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756711-11-iscsi {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.156609 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.156700 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.156989 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.157111 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.157305 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.157418 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.157716 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.157811 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158021 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158112 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158330 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158422 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158650 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158742 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.158956 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159042 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159270 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159364 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159572 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159657 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159890 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.159986 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.160195 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.160289 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.160535 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.160638 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756711-11-iscsi {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.160842 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.160941 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.161157 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.161243 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.161467 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.161567 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.161785 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.161897 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162091 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162212 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162398 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162520 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162649 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162836 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.162963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.163168 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.163276 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.163473 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.163599 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.163797 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.163923 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.164113 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.164209 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.164416 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.164533 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.164760 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.164845 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165060 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165193 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165370 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165458 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165675 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165762 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.165983 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166070 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166283 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166369 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166583 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166669 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166837 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.166970 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.167141 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.167241 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.167461 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.167574 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.167782 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.168459 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.168818 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.168912 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.169189 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.169296 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.169529 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.169623 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.169852 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.169938 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.170174 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.170277 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.170491 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.170656 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.170797 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.170939 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.171086 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.171219 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.171388 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.171528 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.171704 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.171795 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172012 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172108 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172319 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172413 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172650 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172753 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.172970 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173065 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173281 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173375 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173605 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173690 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173912 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.173998 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.174231 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.174324 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.174482 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.174627 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.174786 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.174884 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.175095 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.175180 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.175416 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.175515 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.175726 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.175813 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176037 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176124 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176346 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176441 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176676 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176766 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.176988 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.177074 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.177296 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.177392 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.177602 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.177686 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.177909 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178004 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178219 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178307 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178527 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178624 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178834 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.178928 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.179136 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.179232 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.179457 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.179550 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.179754 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.179841 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180058 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180151 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180364 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180451 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180696 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180783 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.180997 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.181086 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.181304 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.181398 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.181649 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.181749 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.181917 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182003 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182222 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182308 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182529 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182616 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182835 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.182921 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.183138 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.183224 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.183465 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.184224 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.184442 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.184574 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.184956 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.185043 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.185290 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.185436 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.185616 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.185703 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.185919 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186012 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186227 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186323 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186537 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186624 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186847 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.186932 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.187153 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.187247 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.187460 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.187554 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.187765 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.187852 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.188068 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.188162 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.188376 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.188469 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.188703 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.188800 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189008 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189102 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189309 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189395 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189615 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189699 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.189932 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190026 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190233 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190321 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190541 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190627 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190846 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.190935 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.191150 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.191244 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.191455 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.191543 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.191769 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.191885 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.192071 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.192159 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.192371 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.192459 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.192696 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.192784 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.192998 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.193115 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.193299 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.193439 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.193597 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.193757 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.193912 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.194078 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.194235 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.194410 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.194543 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.194725 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.194851 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.195041 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.195156 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.195358 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.195468 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:00:33.195686 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.195788 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.196010 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.196102 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.196343 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.196436 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.196688 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.196775 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197012 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197124 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197331 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197417 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197644 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197735 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.197966 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.198073 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.198295 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.198389 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.198615 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.198701 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.198928 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.199022 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.199305 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.199404 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.199704 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.199904 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.200026 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.200182 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.200354 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.200534 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.200691 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.200871 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.201020 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.201192 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.201331 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.201512 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.201648 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.201867 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202013 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202160 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202309 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202452 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202586 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202774 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.202988 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.203125 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.203259 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.203391 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.203532 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.203723 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.203873 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.204054 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.204192 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.204371 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.204535 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.204717 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.204862 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205028 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205165 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205339 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205481 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205653 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205752 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.205947 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206047 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206284 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206377 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206596 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206691 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206910 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.206997 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.207225 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.207322 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.207535 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.207630 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.207850 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.207936 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.208158 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.208245 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.208465 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.208598 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.208796 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.208883 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.209107 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.209193 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.209412 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.209499 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.209734 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.209821 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210044 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210129 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210367 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210456 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210682 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210770 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.210996 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.211095 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.211307 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.211399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.211619 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.211705 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.211976 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212086 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212235 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212330 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212557 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212647 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212864 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.212966 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.213167 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.213258 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.213475 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.213563 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.213780 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.213881 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.214087 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.214179 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.214413 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.214499 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.214739 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.214827 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.215051 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.215311 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.215455 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.215669 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.215767 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.215986 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.216073 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.216303 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.216391 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.216643 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.216752 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.216950 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217045 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217267 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217354 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217576 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217682 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217881 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.217968 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.218206 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.218301 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.218516 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.218605 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.218822 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.218917 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.219147 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.219235 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.219451 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.219540 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.219757 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.219844 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.220067 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.220153 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.220374 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.220743 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.220959 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221047 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221268 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221366 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221581 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221677 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221888 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.221975 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.222183 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.222287 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.222489 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.222578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.222794 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.222881 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.223099 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.223195 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.223422 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.223510 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.223732 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.223819 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224039 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224140 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224345 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224433 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224672 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224761 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.224985 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.225087 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.225293 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.225381 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.225598 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.225685 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.225903 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226000 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226209 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226297 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226509 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226597 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226812 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.226901 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.227116 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.227211 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.227419 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.227516 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.227721 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.227809 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228039 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228128 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228345 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228433 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228672 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228770 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.228979 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.229092 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.229273 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.229371 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.229613 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.229708 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.229919 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.230008 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.230244 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.230844 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.231118 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.231295 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.231438 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.231732 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.231832 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.232071 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.232177 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.232392 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.232519 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.232738 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.232838 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.233055 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.233150 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.233372 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.233459 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.233687 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.233773 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234004 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234097 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234329 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234424 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234640 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234733 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.234954 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.235038 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.235263 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.235347 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.235580 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.235674 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.235893 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236042 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236203 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236339 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236523 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236629 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236840 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.236935 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.237169 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.237256 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.237477 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.237573 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.237796 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.237888 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.238114 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.238207 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.238429 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.238518 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.238744 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.238846 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239054 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239143 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239367 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239455 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239678 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239765 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.239986 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.240071 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.240304 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.240398 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.240638 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.240725 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.240948 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241033 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241255 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241352 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241570 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241657 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241884 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.241980 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.242197 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.242439 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.242530 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.242611 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.242800 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.242898 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.243107 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.243193 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.243416 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.243504 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.243724 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.243824 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.244037 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.244123 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.244358 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.244445 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.244695 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.244798 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245007 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245096 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245318 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245406 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245623 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245726 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.245924 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.246581 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.246784 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.246902 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.247097 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.247409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.247508 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.247713 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.247814 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248021 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248118 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248352 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248438 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248719 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248810 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.248986 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.249088 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.249289 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.249375 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.249597 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.249692 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.249910 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250007 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250231 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250319 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250543 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250637 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250858 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.250947 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.251173 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.251261 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.251477 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.251572 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.251786 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.251872 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.252104 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.252192 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.252423 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.252586 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.252742 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.252831 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253046 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253140 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253351 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253446 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253667 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253755 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.253983 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254070 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254286 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254380 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254592 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254678 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254908 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.254995 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.255216 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.255322 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.255531 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.255783 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.255870 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.256119 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.256251 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.256439 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.256576 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.256775 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.256862 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.257086 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.257173 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.257401 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.257502 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.257716 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.257811 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258029 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258123 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258343 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258438 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258666 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258755 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.258977 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259072 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259284 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259371 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259593 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259679 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259898 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.259985 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.260208 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.260297 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.260536 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.260626 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.260847 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.261101 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.261205 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.261438 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.261529 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.261832 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.261964 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.262207 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.262414 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.262542 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.262732 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.262823 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263039 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263137 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263356 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263452 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263662 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263751 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.263986 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.264081 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.264299 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.264396 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.264634 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.264723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.264942 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265040 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265248 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265347 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265563 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265652 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265872 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.265967 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.266179 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.266265 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.266484 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.266581 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.266794 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.266890 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.267101 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.267197 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.267407 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.267494 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.267712 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.267866 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268019 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268108 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268334 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268422 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268662 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268762 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.268974 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269061 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269278 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269363 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269581 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269677 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269895 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.269982 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.270200 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.270287 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.270505 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.270601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.270808 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.270896 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.271111 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.271196 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.271422 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.271518 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.271727 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.271815 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272046 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272133 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272358 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272446 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272691 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272789 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.272996 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.273085 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.273311 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.273400 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.273614 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.273700 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.273916 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274002 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274216 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274302 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274520 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274605 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274824 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.274924 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.275127 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.275213 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.275432 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.275527 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.275735 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.275831 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276042 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276127 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276350 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276441 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276679 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276780 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.276988 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.277077 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.277564 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.277671 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.277817 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.277939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.278128 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.278349 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.278438 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.278663 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.278757 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.278972 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279061 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279290 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279389 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279603 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279711 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279909 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.279996 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.280222 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.280309 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.280564 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.280670 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.280876 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.280972 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.281180 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.281266 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.281485 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.281581 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.281793 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.281879 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.282097 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.282182 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.282403 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.282504 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.282708 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.282835 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283016 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283111 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283322 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283411 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283625 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283719 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.283929 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284018 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284238 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284334 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284565 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284654 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284872 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.284970 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.285182 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.285271 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.285505 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.285600 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.285821 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.285910 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.286127 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.286215 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.286437 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.286571 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.286814 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287033 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287138 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287221 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287356 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287452 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287665 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287762 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.287970 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.288059 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.288276 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.288364 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.288608 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.288718 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.288916 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289011 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289220 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289309 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289543 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289639 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289851 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.289953 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.290155 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.290251 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.290460 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.290549 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.290762 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.290858 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.291089 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.291177 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.291395 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.291482 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.291707 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.291803 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.292019 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.292113 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.292334 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.292429 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.292675 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.292762 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.293570 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.293684 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.293841 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.294125 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.294353 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.294465 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.294560 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.294781 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.294869 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.295098 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.295185 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.295412 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.295500 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.295722 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.295810 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296025 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296111 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296335 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296424 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296668 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296758 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.296993 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.297089 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.297305 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.297394 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.297612 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.297707 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.297923 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298010 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298231 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298336 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298536 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298623 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298839 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.298925 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.299152 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.299271 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.299465 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.299587 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.299776 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.299903 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.300089 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.300210 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.300404 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.300547 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.300747 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.300871 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.301061 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.301192 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.301376 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.301509 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.301688 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.301816 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302003 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302234 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302323 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302550 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302646 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302867 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.302964 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.303185 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.303273 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.303491 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.303587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.303792 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.303888 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.304101 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.304188 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.304406 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.304535 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.304744 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.304844 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305048 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305133 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305351 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305475 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305676 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305788 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.305982 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.306101 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.306306 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.306394 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.306703 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.306790 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307017 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307104 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307323 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307409 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307631 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307744 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.307935 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.308057 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.308349 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.308466 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.309303 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.309539 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.309636 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.309871 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310007 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310182 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310335 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310497 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310648 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310816 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.310959 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.311142 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.311276 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.311467 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.311603 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.311783 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.311917 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.312102 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.312212 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.312409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.312526 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.312760 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.312860 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.313087 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.313175 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.313404 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.313500 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.313729 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.313857 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.314148 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.314244 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.314463 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.314550 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.314778 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.314874 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.315103 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.315201 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.315431 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.315526 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.315737 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.315825 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.316043 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.316140 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.316358 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.316447 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.316697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.316826 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317007 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317113 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317321 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317627 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317715 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.317945 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318046 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318257 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318343 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318568 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318655 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318870 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.318965 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.319176 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.319263 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.319499 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.319586 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.319854 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.319949 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.320126 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.320212 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.320441 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.320547 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.320804 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.320894 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.321130 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.321225 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.321439 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.321527 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.321763 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.321852 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322075 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322162 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322382 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322479 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322689 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322784 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.322992 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.323085 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.323298 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.323403 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.323620 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.323709 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.323925 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.324012 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.324281 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.324378 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.324646 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.324868 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.324957 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.325190 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.325285 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.325503 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.325593 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.325813 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.325902 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.326142 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.326240 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.326453 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.326548 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.326779 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.326908 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.327098 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.327195 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.327414 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.327502 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.327728 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.327817 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328031 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328165 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328339 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328427 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328678 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328778 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.328987 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329105 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329292 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329379 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329594 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329680 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329903 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.329991 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.330229 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.330315 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.330537 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.330633 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.330865 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.330953 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.331176 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.331270 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.331483 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.331578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.331793 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.331881 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.332099 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.332186 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.332442 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.332575 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.332773 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.332868 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.333091 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.333187 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.333405 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.333514 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.333709 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.333805 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334014 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334103 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334325 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334426 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334632 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334729 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.334937 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335026 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335242 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335413 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335551 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335647 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335854 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.335942 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.336160 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.336258 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.336466 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.336584 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.336812 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.336900 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.337116 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.337206 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.337439 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.337643 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.337732 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.337976 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.338074 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.338296 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.338394 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.338612 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.338748 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.338929 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339028 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339239 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339326 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339554 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339643 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339895 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.339999 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.340242 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.340388 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.340594 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.340717 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.340916 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341042 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341252 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341364 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341576 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341685 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341907 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.341995 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.342246 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.342334 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.342568 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.342666 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.342887 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.342991 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.343206 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.343295 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.343525 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.343631 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.343840 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.343926 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.344190 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.344367 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.344518 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.344724 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.344840 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.345041 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.345158 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.345357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.345731 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.345937 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346055 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346255 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346371 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346571 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346672 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346884 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.346979 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.347198 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.347296 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.347509 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.347611 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.347822 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.347911 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.348154 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.348291 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.348491 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.348630 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.348824 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.348920 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.349157 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.349244 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.349473 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.349567 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.349787 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.349874 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.350098 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.350184 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.350412 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.350617 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.350770 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.350934 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.351087 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.351269 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.351395 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.351597 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.351709 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.351923 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.352031 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.352245 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.352333 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.352590 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.352681 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.352923 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353232 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353321 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353539 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353636 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353853 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.353949 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.354164 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.354250 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.354468 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.354557 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.354779 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.354877 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.355093 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.355180 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.355984 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.356080 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.356354 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.356616 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.356761 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.357009 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.357334 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.357422 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.357656 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.357757 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.357994 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.358180 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.358323 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.358500 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.358654 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.358837 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.358975 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.359165 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.359286 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.359492 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.359615 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.359812 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.359928 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.360133 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.360227 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.360461 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.360603 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.360791 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.360880 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.361100 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.361189 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.361414 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.361511 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.361726 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.361813 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362032 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362120 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362355 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362449 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362667 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362754 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.362972 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.363059 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.363290 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.363384 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.363601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.363687 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.363910 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.364130 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.364227 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.364491 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.364618 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.364815 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.364914 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.365141 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.365237 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.365452 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.365541 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.365760 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366064 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366158 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366369 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366455 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366681 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366770 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.366984 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.367072 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.367299 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.367394 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.367609 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.367703 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.367914 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368002 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368220 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368307 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368554 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368652 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368867 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.368988 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.369171 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.369261 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.369484 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.369584 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.369790 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.369877 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.370115 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.370220 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.370416 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.370518 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.370720 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.370809 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.371637 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.371742 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.372043 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.372212 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.372619 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.372712 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.372939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.373046 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.373254 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.373353 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.373566 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.373705 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.373885 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374003 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374197 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374318 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374513 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374630 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374822 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.374939 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.375141 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.375268 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.375497 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.375592 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.375809 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.375897 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.376116 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.376211 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.376442 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.376558 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.376773 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.376861 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.377080 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.377169 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.377397 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.377485 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.377709 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.377810 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378021 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378108 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378329 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378414 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378640 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378744 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.378952 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.379047 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.379266 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.379355 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.379576 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.379804 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.379897 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.380138 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.380227 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.380460 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.380612 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.380814 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.380903 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.381147 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.381236 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.381456 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.381553 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.381762 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.381857 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.382070 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.382157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.382381 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.382485 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.382693 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.382783 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383006 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383093 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383319 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383421 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383630 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383717 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.383937 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.384032 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.384244 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.384575 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.384677 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.384889 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.384978 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.385199 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.385297 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.385510 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.385599 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.385821 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.385908 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.386131 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.386227 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.386442 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.386532 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.386837 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.386998 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.387161 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.387410 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.387591 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.387792 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.387882 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.388122 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.388223 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.388446 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.388552 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.388792 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.388895 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.389100 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.389209 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.389409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.389498 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.389719 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.389807 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390031 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390118 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390339 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390433 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390654 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390742 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.390961 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.391050 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.391270 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.391358 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.391573 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.391660 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.391886 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.392196 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.392283 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.392528 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.392655 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.392840 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.392984 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.393152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.393315 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.393457 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.393633 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.393783 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.393962 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.394053 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.394291 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.394380 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.394610 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.394708 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.394977 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395072 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395242 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395331 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395548 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395649 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395853 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.395949 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.396158 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.396247 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.396463 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.396608 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.396790 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.396878 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.397123 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.397212 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.397430 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.397518 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.397743 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.397834 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398064 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398153 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398376 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398465 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398683 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398821 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.398989 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.399091 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.399300 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.399388 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.399607 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.399696 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.399914 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400010 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400218 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400314 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400541 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400633 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400855 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.400961 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.401160 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.401249 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.401462 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.401558 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.401765 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.401862 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.402068 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.402156 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.402921 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.403067 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.403254 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.403548 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.403636 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.403881 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404009 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404196 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404363 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404534 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404626 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404846 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.404935 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.405156 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.405258 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.405463 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.405552 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.405792 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.405879 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.406109 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.406197 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.406427 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.406516 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.406739 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.406826 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407052 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407139 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407366 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407452 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407673 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407805 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.407989 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.408077 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.408305 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.408392 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.408649 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.408739 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.408963 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409061 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409286 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409374 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409595 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409692 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409909 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.409997 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.410225 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.410313 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.410536 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.410634 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.410845 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.410933 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.411155 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.411244 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.411484 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.411581 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.411812 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.411901 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.412117 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.412206 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.412442 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.412781 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.412914 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.413027 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 15:00:33.413128 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.413402 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.413717 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.414046 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.414358 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.414670 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.414981 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.415293 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.415604 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.415921 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.416234 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.416573 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.416895 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.417212 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.417537 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.417898 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.418899 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.419424 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.419763 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.420118 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.420440 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.420809 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.421144 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.421464 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.421782 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.422089 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:00:33.422334 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 15:00:33.567679 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO dbcounter [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Registered counter for database nova_api Sep 19 15:00:33.578278 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Registered counter for database nova_api Sep 19 15:00:33.588583 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.596058 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writer thread running {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.600984 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.607888 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.653979 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.context [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fad812d-08ce-4e89-9888-006021c91877(cell1) {{(pid=106142) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 15:00:33.657832 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:33.658313 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:33.659869 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:33.660619 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:33.661082 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:33.663057 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:33.665080 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO dbcounter [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Registered counter for database nova_cell0 Sep 19 15:00:33.666399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.context [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fad812d-08ce-4e89-9888-006021c91877(cell1) {{(pid=106141) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 15:00:33.669438 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO dbcounter [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Registered counter for database nova_cell1 Sep 19 15:00:33.670970 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:33.671528 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:33.673127 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:33.673870 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:33.674320 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:33.676401 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:33.677169 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.678508 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Registered counter for database nova_cell0 Sep 19 15:00:33.679307 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.682625 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Registered counter for database nova_cell1 Sep 19 15:00:33.684903 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writer thread running {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.687552 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writer thread running {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.690845 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.692590 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.698660 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.701128 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.835258 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO dbcounter [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Registered counter for database nova_cell0 Sep 19 15:00:33.842333 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.847082 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writer thread running {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:33.851505 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Registered counter for database nova_cell0 Sep 19 15:00:33.861332 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:00:33.865861 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:00:34.329655 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: WARNING keystonemiddleware.auth_token [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:00:34.336934 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: WARNING keystonemiddleware.auth_token [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:00:34.346519 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:00:34.353802 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:00:34.696058 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: WARNING keystonemiddleware.auth_token [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:00:34.700998 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:00:34.702765 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: WARNING keystonemiddleware.auth_token [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:00:34.706921 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-b760fa93-05f6-43e9-a855-faeb2726c297 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:00:34.708027 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56365af909c0 pid: 106142 (default app) Sep 19 15:00:34.710116 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:34.711287 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Sep 19 15:00:34.711710 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Mon Sep 19 15:00:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:34.712152 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56365af909c0 pid: 106141 (default app) Sep 19 15:02:00.745255 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:00.746864 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002369 Sep 19 15:02:00.752238 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:00.761470 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:00.762705 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_cell0:SELECT=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:00.763412 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_cell1:SELECT=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:00.765652 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:01.661425 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-d90f2278-5d6a-466d-9a49-a3c92a5f2176 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:01.693002 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-d90f2278-5d6a-466d-9a49-a3c92a5f2176 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938699 Sep 19 15:02:01.693754 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1292 bytes} [Mon Sep 19 15:02:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:04.319109 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:04.320612 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-bdd82461-84a1-47d8-97ed-1c717e114d45 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 19 15:02:04.321014 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:04.781939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a081d9ad-f340-45d3-945f-4bcb48ed1dfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:04.886385 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-a081d9ad-f340-45d3-945f-4bcb48ed1dfe admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.558858 Sep 19 15:02:04.887143 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:04.901029 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_api:SELECT=3 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.902042 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_cell1:SELECT=3 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.904079 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_cell0:SELECT=3 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.905094 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:05.112011 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-517f903a-af17-4e22-9e32-dd6489fd9c25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:05.251744 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-517f903a-af17-4e22-9e32-dd6489fd9c25 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.356115 Sep 19 15:02:05.252587 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1336 bytes} [Mon Sep 19 15:02:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:07.906245 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a081d9ad-f340-45d3-945f-4bcb48ed1dfe admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:07.907473 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-a081d9ad-f340-45d3-945f-4bcb48ed1dfe admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Sep 19 15:02:07.908077 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:08.553502 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-fc48817d-a8a1-42bc-bffc-fb989e1efc76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "name": "ds512M", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:08.695893 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-fc48817d-a8a1-42bc-bffc-fb989e1efc76 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781507 Sep 19 15:02:08.696626 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:08.708796 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-38c36096-18f7-482f-a60d-041a8772becd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:08.807858 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-38c36096-18f7-482f-a60d-041a8772becd admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102748 Sep 19 15:02:08.808458 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1336 bytes} [Mon Sep 19 15:02:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:11.439136 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-fc48817d-a8a1-42bc-bffc-fb989e1efc76 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:11.440273 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-fc48817d-a8a1-42bc-bffc-fb989e1efc76 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Sep 19 15:02:11.440724 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:11.874423 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-147d9cd0-b7eb-47cd-8ea3-bf763bc56891 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "vcpus": 1, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:12.004762 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-147d9cd0-b7eb-47cd-8ea3-bf763bc56891 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556910 Sep 19 15:02:12.004762 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:12.017511 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-f9535439-144d-4b60-b89e-5ba6b1591014 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:12.105259 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-f9535439-144d-4b60-b89e-5ba6b1591014 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091491 Sep 19 15:02:12.105845 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1336 bytes} [Mon Sep 19 15:02:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:14.743601 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-147d9cd0-b7eb-47cd-8ea3-bf763bc56891 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:14.745232 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-147d9cd0-b7eb-47cd-8ea3-bf763bc56891 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Sep 19 15:02:14.745642 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:15.176230 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-3eea5974-5236-4f1d-a111-b8934e5aadf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:15.283820 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-3eea5974-5236-4f1d-a111-b8934e5aadf9 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530921 Sep 19 15:02:15.284516 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:15.297134 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-167a80ac-eeb2-4857-8827-16e3d27e38a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:15.382747 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-167a80ac-eeb2-4857-8827-16e3d27e38a6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089216 Sep 19 15:02:15.383639 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1336 bytes} [Mon Sep 19 15:02:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:18.095195 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-3eea5974-5236-4f1d-a111-b8934e5aadf9 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:18.096218 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-3eea5974-5236-4f1d-a111-b8934e5aadf9 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 19 15:02:18.096914 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:18.523522 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b00fba35-4326-435b-92b8-1aa1073277f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:18.593010 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b00fba35-4326-435b-92b8-1aa1073277f9 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489614 Sep 19 15:02:18.593630 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:02:18.607710 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-3f059155-d2c6-44dc-8412-54f53f42a594 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:18.687064 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-3f059155-d2c6-44dc-8412-54f53f42a594 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084205 Sep 19 15:02:18.687612 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1336 bytes} [Mon Sep 19 15:02:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:21.529808 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b00fba35-4326-435b-92b8-1aa1073277f9 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:21.531012 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b00fba35-4326-435b-92b8-1aa1073277f9 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 19 15:02:21.531288 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:21.971282 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-2d0a3014-64b1-4919-a2d4-23ffacf158c3 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:21.998374 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-2d0a3014-64b1-4919-a2d4-23ffacf158c3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460844 Sep 19 15:02:21.998921 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1292 bytes} [Mon Sep 19 15:02:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:02:24.644893 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b00fba35-4326-435b-92b8-1aa1073277f9 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:24.645992 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b00fba35-4326-435b-92b8-1aa1073277f9 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Sep 19 15:02:24.646400 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:25.048525 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-48aeb501-5865-4945-8b83-c5c854a0ca8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny"}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:25.125373 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-48aeb501-5865-4945-8b83-c5c854a0ca8a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.472271 Sep 19 15:02:25.125926 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:25.138077 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-692473b9-6f23-4cde-a345-db8500e8ea12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:25.231560 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-692473b9-6f23-4cde-a345-db8500e8ea12 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097072 Sep 19 15:02:25.232200 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1333 bytes} [Mon Sep 19 15:02:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:27.908184 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-48aeb501-5865-4945-8b83-c5c854a0ca8a admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:27.909245 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-48aeb501-5865-4945-8b83-c5c854a0ca8a admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 19 15:02:27.909647 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:28.264172 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-5f77dca2-5c24-4c19-901f-c2d5b30a6a50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "2", "vcpus": 1}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:28.361139 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-5f77dca2-5c24-4c19-901f-c2d5b30a6a50 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444282 Sep 19 15:02:28.361706 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:02:28.374386 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-67300bbe-626e-45a8-946b-9903a9495d6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:28.453732 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-67300bbe-626e-45a8-946b-9903a9495d6a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082976 Sep 19 15:02:28.454768 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1333 bytes} [Mon Sep 19 15:02:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:31.160915 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-5f77dca2-5c24-4c19-901f-c2d5b30a6a50 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:31.161828 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-5f77dca2-5c24-4c19-901f-c2d5b30a6a50 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 19 15:02:31.162540 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:31.614087 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-9271454a-d43b-44eb-aff3-717e33cdf225 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:31.700595 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-9271454a-d43b-44eb-aff3-717e33cdf225 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.530622 Sep 19 15:02:31.701149 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:31.713826 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-9c83fbb5-2038-42d3-bd33-32ce75aeff3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:31.724830 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:31.795743 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-9c83fbb5-2038-42d3-bd33-32ce75aeff3a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086197 Sep 19 15:02:31.796334 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1333 bytes} [Mon Sep 19 15:02:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:34.504720 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-9271454a-d43b-44eb-aff3-717e33cdf225 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:34.505736 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-9271454a-d43b-44eb-aff3-717e33cdf225 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 19 15:02:34.506289 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:34.958420 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-de0aa199-9e5c-41b6-8efa-ce91cda16f68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:35.043687 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-de0aa199-9e5c-41b6-8efa-ce91cda16f68 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.530883 Sep 19 15:02:35.044508 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:02:35.061335 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-0191dea3-4a32-421e-8793-c8c2a5592a95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:35.147702 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-0191dea3-4a32-421e-8793-c8c2a5592a95 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090370 Sep 19 15:02:35.148295 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1333 bytes} [Mon Sep 19 15:02:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:37.837729 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-de0aa199-9e5c-41b6-8efa-ce91cda16f68 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:37.838746 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-de0aa199-9e5c-41b6-8efa-ce91cda16f68 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Sep 19 15:02:37.839146 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:38.261691 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-29a6bcbb-24a0-407c-a8b5-45fabed644ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "id": "5", "vcpus": 8}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:38.268674 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:38.336156 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-29a6bcbb-24a0-407c-a8b5-45fabed644ff admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490968 Sep 19 15:02:38.336875 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1283 bytes} [Mon Sep 19 15:02:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:02:38.350885 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-33173b93-40b3-4ac2-8325-6ee488a33b52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:38.436522 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-33173b93-40b3-4ac2-8325-6ee488a33b52 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090911 Sep 19 15:02:38.437503 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1333 bytes} [Mon Sep 19 15:02:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:55.815617 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-29a6bcbb-24a0-407c-a8b5-45fabed644ff admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:55.816663 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-29a6bcbb-24a0-407c-a8b5-45fabed644ff admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 19 15:02:55.817073 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:55.828824 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:56.226419 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-be627109-87bb-48d9-b5e2-66485b8efd23 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:56.245028 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-be627109-87bb-48d9-b5e2-66485b8efd23 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421033 Sep 19 15:02:56.245564 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1292 bytes} [Mon Sep 19 15:02:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:57.583065 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-29a6bcbb-24a0-407c-a8b5-45fabed644ff admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:57.584111 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-29a6bcbb-24a0-407c-a8b5-45fabed644ff admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 19 15:02:57.584664 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:02:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:58.111472 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-f461dbcb-7b97-4ff7-b3ba-ad57ba946cad admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.116774 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.wsgi [None req-f461dbcb-7b97-4ff7-b3ba-ad57ba946cad admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-f461dbcb-7b97-4ff7-b3ba-ad57ba946cad admin admin] Request method failure captured: Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Accept: application/json Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Accept-Encoding: gzip, deflate Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Connection: keep-alive Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Content-Length: 0 Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Host: 10.222.0.75 Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Openstack-Api-Version: compute 2.92 Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Openstack-System-Scope: None Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: User-Agent: python-novaclient Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Auth-Token: gAAAAABjKIShYs_Thooa0UR4TOgO3hQzed6yFPnY-gPr_pPbBVgOvMkGfBz-hfj3DhdvduKqG4otjHjISF8EfGuJv66BnDf-u-NxYxXOLTX-7eqkB3quHT_avDnDHWDmGLLyNvz92biz3lGPCFZingJ4arfAlv9-rYdcuz3jiZvRkG66pEofmKE Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Domain-Id: None Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Domain-Name: None Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Identity-Status: Confirmed Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Is-Admin-Project: True Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Domain-Id: default Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Domain-Name: Default Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Name: admin Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Role: member,reader,admin Sep 19 15:02:58.120645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Roles: member,reader,admin Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9905c16dd71145d6a307772e4fe88d81"}]}] Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant: admin Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant-Name: admin Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User: admin Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Domain-Id: default Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Domain-Name: Default Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Id: 46687a8108714da08b34f26401622753 Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Name: admin Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: method: > Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: exception: Flavor 42 could not be found. Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: action_args: {'id': '42'} Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:58.122357 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:58.123587 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.125011 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-f461dbcb-7b97-4ff7-b3ba-ad57ba946cad admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:58.126344 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-f461dbcb-7b97-4ff7-b3ba-ad57ba946cad admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397145 Sep 19 15:02:58.126344 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Sep 19 15:02:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 15:02:58.132260 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-61fe3f80-0003-4c0f-ae67-cb45523535f3 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.154423 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-61fe3f80-0003-4c0f-ae67-cb45523535f3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026192 Sep 19 15:02:58.166059 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Sep 19 15:02:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:02:58.166252 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-80300c4b-c3d2-4d96-a869-ea32fdf448b5 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.187374 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-80300c4b-c3d2-4d96-a869-ea32fdf448b5 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026447 Sep 19 15:02:58.187916 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Sep 19 15:02:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:02:58.197736 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-4e02f624-adc5-4dc6-9673-030a021322c3 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.203452 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.wsgi [None req-4e02f624-adc5-4dc6-9673-030a021322c3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-4e02f624-adc5-4dc6-9673-030a021322c3 admin admin] Request method failure captured: Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Accept: application/json Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Accept-Encoding: gzip, deflate Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Connection: keep-alive Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Content-Length: 0 Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Host: 10.222.0.75 Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Openstack-Api-Version: compute 2.92 Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Openstack-System-Scope: None Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: User-Agent: python-novaclient Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Auth-Token: gAAAAABjKIShYs_Thooa0UR4TOgO3hQzed6yFPnY-gPr_pPbBVgOvMkGfBz-hfj3DhdvduKqG4otjHjISF8EfGuJv66BnDf-u-NxYxXOLTX-7eqkB3quHT_avDnDHWDmGLLyNvz92biz3lGPCFZingJ4arfAlv9-rYdcuz3jiZvRkG66pEofmKE Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Domain-Id: None Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Domain-Name: None Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Identity-Status: Confirmed Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Is-Admin-Project: True Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Domain-Id: default Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Domain-Name: Default Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Name: admin Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Role: member,reader,admin Sep 19 15:02:58.206714 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Roles: member,reader,admin Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9905c16dd71145d6a307772e4fe88d81"}]}] Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant: admin Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant-Name: admin Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User: admin Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Domain-Id: default Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Domain-Name: Default Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Id: 46687a8108714da08b34f26401622753 Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Name: admin Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: method: > Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: exception: Flavor 42 could not be found. Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: action_args: {'id': '42'} Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:02:58.217723 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:58.218697 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:02:58.219990 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-4e02f624-adc5-4dc6-9673-030a021322c3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:02:58.221361 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-4e02f624-adc5-4dc6-9673-030a021322c3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014495 Sep 19 15:02:58.221361 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Sep 19 15:02:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:59.435573 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-80300c4b-c3d2-4d96-a869-ea32fdf448b5 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:59.437799 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-80300c4b-c3d2-4d96-a869-ea32fdf448b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Sep 19 15:02:59.438223 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:02:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:59.993052 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-14fe1154-222e-4ef1-b3c4-3d8c73ddb44b admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:59.998061 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.wsgi [None req-14fe1154-222e-4ef1-b3c4-3d8c73ddb44b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-14fe1154-222e-4ef1-b3c4-3d8c73ddb44b admin admin] Request method failure captured: Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Accept: application/json Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Accept-Encoding: gzip, deflate Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Connection: keep-alive Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Content-Length: 0 Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Host: 10.222.0.75 Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Openstack-Api-Version: compute 2.92 Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Openstack-System-Scope: None Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: User-Agent: python-novaclient Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Auth-Token: gAAAAABjKISjM3mxWDgCAqxRtQUXdpsyQtcVgfL9ln6CEY9yUW7eIqRWH9avfCAKOiivIuc2HWLdJKDXh_PDxQfqLJzqT3KIxD9PmvbR6Qdd1pcoktOfvHjf7ej_5OiwCRKBEs1Aobhgjatq-p8W-axfRNr2gftA0MFaWQAu35R4DjeaET4O-TE Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Domain-Id: None Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Domain-Name: None Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Identity-Status: Confirmed Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Is-Admin-Project: True Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Domain-Id: default Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Domain-Name: Default Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Name: admin Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Role: member,reader,admin Sep 19 15:02:59.999601 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Roles: member,reader,admin Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9905c16dd71145d6a307772e4fe88d81"}]}] Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant: admin Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant-Name: admin Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User: admin Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Domain-Id: default Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Domain-Name: Default Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Id: 46687a8108714da08b34f26401622753 Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Name: admin Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: method: > Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: exception: Flavor 84 could not be found. Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: action_args: {'id': '84'} Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:00.000963 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:00.001808 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.002894 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-14fe1154-222e-4ef1-b3c4-3d8c73ddb44b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:00.004096 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-14fe1154-222e-4ef1-b3c4-3d8c73ddb44b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409206 Sep 19 15:03:00.004096 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Sep 19 15:02:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:00.011149 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-2adc94d3-55ea-43e6-b31e-c0cbc3fa5b73 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:00.026810 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-2adc94d3-55ea-43e6-b31e-c0cbc3fa5b73 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019701 Sep 19 15:03:00.027332 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Sep 19 15:03:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:03:00.036610 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-a324ac5d-c200-470f-9d5d-1207a8648c33 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:00.051878 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-a324ac5d-c200-470f-9d5d-1207a8648c33 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018663 Sep 19 15:03:00.052389 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Sep 19 15:03:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:03:00.061674 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-c00a3270-ddfa-4800-a978-870226f61df6 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:00.066645 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.wsgi [None req-c00a3270-ddfa-4800-a978-870226f61df6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-c00a3270-ddfa-4800-a978-870226f61df6 admin admin] Request method failure captured: Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Accept: application/json Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Accept-Encoding: gzip, deflate Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Connection: keep-alive Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Content-Length: 0 Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Host: 10.222.0.75 Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Openstack-Api-Version: compute 2.92 Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Openstack-System-Scope: None Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: User-Agent: python-novaclient Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Auth-Token: gAAAAABjKISjM3mxWDgCAqxRtQUXdpsyQtcVgfL9ln6CEY9yUW7eIqRWH9avfCAKOiivIuc2HWLdJKDXh_PDxQfqLJzqT3KIxD9PmvbR6Qdd1pcoktOfvHjf7ej_5OiwCRKBEs1Aobhgjatq-p8W-axfRNr2gftA0MFaWQAu35R4DjeaET4O-TE Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Domain-Id: None Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Domain-Name: None Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Identity-Status: Confirmed Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Is-Admin-Project: True Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Domain-Id: default Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Domain-Name: Default Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Name: admin Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Role: member,reader,admin Sep 19 15:03:00.068157 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Roles: member,reader,admin Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9905c16dd71145d6a307772e4fe88d81"}]}] Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant: admin Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant-Name: admin Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User: admin Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Domain-Id: default Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Domain-Name: Default Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Id: 46687a8108714da08b34f26401622753 Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Name: admin Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: method: > Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: exception: Flavor 84 could not be found. Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: action_args: {'id': '84'} Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:00.069781 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:00.071399 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:00.072711 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-c00a3270-ddfa-4800-a978-870226f61df6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:00.073942 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-c00a3270-ddfa-4800-a978-870226f61df6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011395 Sep 19 15:03:00.073942 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Sep 19 15:03:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:01.292583 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-a324ac5d-c200-470f-9d5d-1207a8648c33 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.293597 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-a324ac5d-c200-470f-9d5d-1207a8648c33 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 19 15:03:01.293993 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:01.824596 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a9b0a48b-692e-4335-bbd8-5f8b84a72c52 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.830320 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.wsgi [None req-a9b0a48b-692e-4335-bbd8-5f8b84a72c52 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a9b0a48b-692e-4335-bbd8-5f8b84a72c52 admin admin] Request method failure captured: Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Accept: application/json Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Accept-Encoding: gzip, deflate Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Connection: keep-alive Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Content-Length: 0 Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Host: 10.222.0.75 Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Openstack-Api-Version: compute 2.92 Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Openstack-System-Scope: None Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: User-Agent: python-novaclient Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Auth-Token: gAAAAABjKISlnbLgnwhIoJYZnMinpLPKExkmA61dAF7LzoSpjfZzkT7i3yyxVZkiAU0APgsdEFiY803YtFK_CHW_eBqQ51hZn-I05oQeH9-2VNtKe6mYg72oBdKZAFromYyAsc5Sz4U1S_rOvekR8GsFUTFliw-g1Z2xbMXjeh1uDMtSnertMPY Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Domain-Id: None Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Domain-Name: None Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Identity-Status: Confirmed Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Is-Admin-Project: True Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Domain-Id: default Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Domain-Name: Default Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Project-Name: admin Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Role: member,reader,admin Sep 19 15:03:01.831939 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Roles: member,reader,admin Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9905c16dd71145d6a307772e4fe88d81"}]}] Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant: admin Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-Tenant-Name: admin Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User: admin Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Domain-Id: default Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Domain-Name: Default Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Id: 46687a8108714da08b34f26401622753 Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: X-User-Name: admin Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: method: > Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: exception: Flavor 451 could not be found. Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: action_args: {'id': '451'} Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:01.833584 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:01.834578 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.835859 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a9b0a48b-692e-4335-bbd8-5f8b84a72c52 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:01.837810 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-a9b0a48b-692e-4335-bbd8-5f8b84a72c52 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401782 Sep 19 15:03:01.837810 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:01.843936 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-7c4e1f9c-aabf-4b52-b82e-ac46ca641ac0 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.859486 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-7c4e1f9c-aabf-4b52-b82e-ac46ca641ac0 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019059 Sep 19 15:03:01.860005 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:03:01.869986 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.884740 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018829 Sep 19 15:03:01.885266 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:03:01.894280 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-d569d1a5-8cd4-4503-b195-f6c1c7038431 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.899678 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.wsgi [None req-d569d1a5-8cd4-4503-b195-f6c1c7038431 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-d569d1a5-8cd4-4503-b195-f6c1c7038431 admin admin] Request method failure captured: Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Accept: application/json Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Accept-Encoding: gzip, deflate Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Connection: keep-alive Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Content-Length: 0 Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Host: 10.222.0.75 Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Openstack-Api-Version: compute 2.92 Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Openstack-System-Scope: None Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: User-Agent: python-novaclient Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Auth-Token: gAAAAABjKISlnbLgnwhIoJYZnMinpLPKExkmA61dAF7LzoSpjfZzkT7i3yyxVZkiAU0APgsdEFiY803YtFK_CHW_eBqQ51hZn-I05oQeH9-2VNtKe6mYg72oBdKZAFromYyAsc5Sz4U1S_rOvekR8GsFUTFliw-g1Z2xbMXjeh1uDMtSnertMPY Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Domain-Id: None Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Domain-Name: None Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Identity-Status: Confirmed Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Is-Admin-Project: True Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Domain-Id: default Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Domain-Name: Default Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Project-Name: admin Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Role: member,reader,admin Sep 19 15:03:01.901263 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Roles: member,reader,admin Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9905c16dd71145d6a307772e4fe88d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9905c16dd71145d6a307772e4fe88d81"}]}] Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant: admin Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant-Id: 9905c16dd71145d6a307772e4fe88d81 Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-Tenant-Name: admin Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User: admin Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Domain-Id: default Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Domain-Name: Default Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Id: 46687a8108714da08b34f26401622753 Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: X-User-Name: admin Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: method: > Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: exception: Flavor 451 could not be found. Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: action_args: {'id': '451'} Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:01.902819 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:01.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: ERROR nova.api.openstack.wsgi Sep 19 15:03:01.905152 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-d569d1a5-8cd4-4503-b195-f6c1c7038431 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:01.906409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-d569d1a5-8cd4-4503-b195-f6c1c7038431 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011834 Sep 19 15:03:01.906409 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:03.121944 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:03.122955 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 19 15:03:03.123353 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:03.662550 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-0fc9ae9c-748f-411c-b5e4-2acd0f5f923d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:03.731214 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-0fc9ae9c-748f-411c-b5e4-2acd0f5f923d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.469334 Sep 19 15:03:03.731695 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Sep 19 15:03:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:03:04.949226 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:04.950249 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 19 15:03:04.950684 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:03:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:05.479088 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-16201b97-fcb9-4ebf-811c-73cb189c838f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:05.560639 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-16201b97-fcb9-4ebf-811c-73cb189c838f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.475122 Sep 19 15:03:05.561199 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Sep 19 15:03:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:03:06.784436 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:06.785490 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 19 15:03:06.785891 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:03:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:07.310093 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-d42e7abf-6eae-49eb-9167-93b2653c1a03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:07.368371 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-d42e7abf-6eae-49eb-9167-93b2653c1a03 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.442944 Sep 19 15:03:07.368959 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Sep 19 15:03:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:03:08.602661 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:08.603672 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Sep 19 15:03:08.604065 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:09.125594 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-fa792465-4ac8-4a0e-ab6a-8abcd6b0d910 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:09.199309 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-fa792465-4ac8-4a0e-ab6a-8abcd6b0d910 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.458741 Sep 19 15:03:09.199867 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Sep 19 15:03:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:03:10.413422 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:10.415255 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Sep 19 15:03:10.415720 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:03:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:10.929555 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-d4162d50-2bdc-4c59-a6cc-72607cfaab05 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:10.949792 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-d4162d50-2bdc-4c59-a6cc-72607cfaab05 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399595 Sep 19 15:03:10.950332 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Mon Sep 19 15:03:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:04:08.369738 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.370685 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-534efe98-06bf-43d4-8e86-c697e09fb35e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 19 15:04:08.371088 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 931 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:04:08.382054 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:08.761705 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-b9040615-3854-4ff1-b497-b63ccbc0ed35 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.782205 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-b9040615-3854-4ff1-b497-b63ccbc0ed35 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405077 Sep 19 15:04:08.782755 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1292 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:04:08.804007 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=14 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:08.807661 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-35498944-1905-41fb-8c6d-eef5f9353ad5 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.814753 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-35498944-1905-41fb-8c6d-eef5f9353ad5 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012820 Sep 19 15:04:08.820358 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1283 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:08.827180 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-ba3aeacd-8912-4e35-9ce4-cdbba506beee admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.834550 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-ba3aeacd-8912-4e35-9ce4-cdbba506beee admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010966 Sep 19 15:04:08.835074 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1286 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:08.846521 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.853959 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011206 Sep 19 15:04:08.854470 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1286 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:04:08.865387 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-fe6cdafa-8642-4772-9456-ba079275ac3b admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:04:08.873225 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-fe6cdafa-8642-4772-9456-ba079275ac3b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011293 Sep 19 15:04:08.873746 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1283 bytes} [Mon Sep 19 15:04:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:07:32.181081 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:32.182273 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Sep 19 15:07:32.182621 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:32.327549 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_api:SELECT=6 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:32.470656 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:32.475597 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:32.476075 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:32.476529 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:32.477251 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:32.477699 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:32.478120 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:32.510856 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-b8f49c78-6ea6-400c-addd-e2b24b662ef2 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.184402 Sep 19 15:07:32.511422 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Sep 19 15:07:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:07:33.616849 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:33.617902 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Sep 19 15:07:33.618326 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:33.810977 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:33.814426 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:33.814895 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:33.815325 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:33.816032 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:33.816491 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:33.816908 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:33.836044 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-40ede876-4368-406b-ac75-8168f3040eb2 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076610 Sep 19 15:07:33.836614 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Sep 19 15:07:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:07:45.355987 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:45.357101 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 19 15:07:45.357541 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:45.505973 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_cell0:SELECT=4 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:45.506695 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_cell1:SELECT=4 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:45.507350 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG dbcounter [-] [106142] Writing DB stats nova_api:SELECT=8 {{(pid=106142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:45.556466 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:45.559968 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:45.560388 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:45.560841 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:45.561559 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:45.562002 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:45.562417 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:45.587638 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-768a7c24-038f-41e3-a754-8b6672e0b9e1 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.086052 Sep 19 15:07:45.588778 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Sep 19 15:07:45 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:07:46.665737 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:46.667551 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-b9c21e86-afd1-45f9-90e3-34726b24e895 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Sep 19 15:07:46.667959 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Sep 19 15:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:07:46.865691 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG nova.api.openstack.wsgi [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Calling method '>' {{(pid=106142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:07:46.869888 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:46.870715 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:46.871199 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:46.872357 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:07:46.873206 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:07:46.873708 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: DEBUG oslo_concurrency.lockutils [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:07:46.898730 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: INFO nova.api.openstack.requestlog [None req-b5ea51eb-9821-40a5-9081-995f1ad7b773 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.087789 Sep 19 15:07:46.899316 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: [pid: 106142|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Sep 19 15:07:46 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:08:48.414258 dv-cinder-756711-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 15:08:48.415357 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: Mon Sep 19 15:08:48 2022 - graceful shutdown triggered... Sep 19 15:08:48.415838 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: Gracefully killing worker 1 (pid: 106141)... Sep 19 15:08:48.416203 dv-cinder-756711-11-iscsi devstack@n-api.service[106142]: Gracefully killing worker 2 (pid: 106142)... Sep 19 15:08:48.540640 dv-cinder-756711-11-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=4 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:49.416227 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: worker 1 buried after 1 seconds Sep 19 15:08:49.416664 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: worker 2 buried after 1 seconds Sep 19 15:08:49.416664 dv-cinder-756711-11-iscsi devstack@n-api.service[106140]: goodbye to uWSGI. Sep 19 15:08:49.417875 dv-cinder-756711-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 15:08:49.418440 dv-cinder-756711-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 15:08:49.421216 dv-cinder-756711-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 15:08:49.431330 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 15:08:49 2022] *** Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: nodename: dv-cinder-756711-11-iscsi Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: machine: x86_64 Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: clock source: unix Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: pcre jit disabled Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: detected number of CPU cores: 4 Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: current working directory: / Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: detected binary path: /usr/bin/uwsgi-core Sep 19 15:08:49.433354 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: your processes number limit is 47680 Sep 19 15:08:49.434090 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: your memory page size is 4096 bytes Sep 19 15:08:49.434090 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: detected max file descriptor number: 2048 Sep 19 15:08:49.434090 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: lock engine: pthread robust mutexes Sep 19 15:08:49.434090 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: thunder lock: enabled Sep 19 15:08:49.434090 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 15:08:49.434090 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 15:08:49.474665 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: Python main interpreter initialized at 0x56086f19a9c0 Sep 19 15:08:49.474665 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: python threads support enabled Sep 19 15:08:49.474665 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: your server socket listen backlog is limited to 100 connections Sep 19 15:08:49.474665 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: your mercy for graceful operations on workers is 90 seconds Sep 19 15:08:49.475096 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 15:08:49.475096 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: *** Operational MODE: preforking *** Sep 19 15:08:49.475303 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: *** uWSGI is running in multiple interpreter mode *** Sep 19 15:08:49.475303 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: spawned uWSGI master process (pid: 121156) Sep 19 15:08:49.475509 dv-cinder-756711-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 15:08:49.476092 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: spawned uWSGI worker 1 (pid: 121177, cores: 1) Sep 19 15:08:49.476664 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: spawned uWSGI worker 2 (pid: 121178, cores: 1) Sep 19 15:08:49.477134 dv-cinder-756711-11-iscsi devstack@n-api.service[121156]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 15:08:50.156571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 15:08:50.167585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 15:08:51.349943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:08:51.349943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: from cryptography.utils import int_from_bytes Sep 19 15:08:51.350682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:08:51.350682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: from cryptography.utils import int_from_bytes Sep 19 15:08:51.353499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:08:51.353499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: from cryptography.utils import int_from_bytes Sep 19 15:08:51.353974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 15:08:51.353974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: from cryptography.utils import int_from_bytes Sep 19 15:08:53.809450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 15:08:53.810046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 15:08:53.810238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 15:08:53.810606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 15:08:53.810863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 15:08:53.811254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.811582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.811907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.812226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.812592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.812896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.813217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.813328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 15:08:53.813708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 15:08:53.813784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.813869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.814072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 15:08:53.814184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.814413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.814525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 15:08:53.814704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 15:08:53.814887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756711-11-iscsi {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.815084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.815265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.815424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.815527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.815749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.815858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.816078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.816184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.816417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.816546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.816766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.816864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.817076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.817173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.818446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.818567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.818674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.818674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.818846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.818943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756711-11-iscsi {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.819846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.820014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.820138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.820337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.820707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.820827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.821038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.821157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.821450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756711-11-iscsi {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.821756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.822886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.823130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.823252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.823403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.823535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.823732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.823847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.824057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.824166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.824375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.824507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.824739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.824873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756711-11-iscsi {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825780 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.825991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.826098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.826299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.826399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.826608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.826790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.826927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.827111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.827234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.827430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.827529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.827761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.827865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.828071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.828165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.828394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.828518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.828738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.828849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.829993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.830209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.830354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.830517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.830620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.830823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.830923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.831128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.831222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.831433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.831535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.831738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.831839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.832987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.833992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.834197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.834308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.834514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.834620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.834829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.834928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.835135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.835246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.835449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.835565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.835763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.835865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.836610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.836727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.836938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.837152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.837260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.837562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.837661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.837872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.837966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.838180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.838287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.838502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.838603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.838834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.838934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.839993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.840118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.840312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.840464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.840643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.840812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.840941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.841135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.841236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.841467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.841561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.841801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.841906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.842120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.842260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.842425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.842519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.842733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.842852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.843966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.844075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.844274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.844382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.844604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.844704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.844931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.845975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.846182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.846293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.846491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.846592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.846811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.846924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.847115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.847213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.847420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.847527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.847990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.848097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.848298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.848403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.848627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.848738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.848942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.849097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.849258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.849359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.849579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.849687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.849905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.850985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.851151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.851257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.851460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.851569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.851846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.852990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.853071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.853412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.853579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.853734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.853888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.854958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.855117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.855262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.855432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.855432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.855826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.856014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.856215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.856490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.856676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.856864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.857012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.857168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.857322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.857467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.857671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.857859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.858014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.858178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.858335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.858497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.858649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.858793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.858944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.859103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.859248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.859405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.859556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.859701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.859852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.860102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.860255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.860401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.860591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.860899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.861065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.861212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 15:08:53.861363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.861509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.861654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.861891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.862103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.862265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.862410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.862555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.862707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.862707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.863014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.863161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.863323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.863654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.863809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.863954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.864099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.864255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.864401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.864401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.864702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.864702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.865903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.866054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.866199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.866343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.866515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.866731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.866907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.867060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.867205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.867860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.868053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.868306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.868833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.869919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.870097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.870324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.870482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.870638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.870784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.871095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.871257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.871403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.871555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.871717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.871871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.872027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.872221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.872372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.872548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.872714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.872868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.873015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.873167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.873312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.873457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.873715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.873957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.874110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.874281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.874281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.874558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.874713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.874866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.875917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.876071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.876234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.876390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.876635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.876878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.877940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.878093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.878246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.878417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.878563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.878721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.878866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.879017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.879310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.879505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.879677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.879836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.879989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.880146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.880320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.880596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.880762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.880916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.881401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.881567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.881728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.881874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.882026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.882179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.882374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.882520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.882678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.882823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.883023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.883741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.884254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.884443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.884628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.884777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.884921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.885994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.886147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.886311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.886457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.886602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.886745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.886916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.887141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.887305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.887451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.887596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.887740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.887884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.888992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.889137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.889805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.889978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.890135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.890285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.890486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.890486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.890894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.891046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.891281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.891562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.891734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.891887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.892038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.892188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.892397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.892609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.892777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.892954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.893107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.893265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.893417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.893577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.893730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.893881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.894062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.894291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.894448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.894613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.894790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.895981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.896133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.896290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.896455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.896652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.896812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.896971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.897142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.897382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.897729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.897894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.898054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.898217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.898369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.898520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.898729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.898972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.899220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.899475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.899667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.899821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.900006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.900172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.900332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.900506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.900664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.900921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.901091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.901261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.901511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.901743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.901901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.902063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.902223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.902441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.902608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.902767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.902918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.903084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.903255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.903416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.903569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.903718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.903876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.904043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.904205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.904460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.904643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.904806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.904957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.905223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.905223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.905529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.905688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.905839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.906939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.907099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.907257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.907493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.907653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.907804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.907964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.908124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.908275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.908425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.908636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.908636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.908956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.909116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.909278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.909436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.909596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.909759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.909911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.910071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.910221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.910416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.910578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.910745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.910934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.911161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.911325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.911502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.911741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.911981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.912146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.912305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.912538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.912710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.912872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.913106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.913268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.913431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.913592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.913751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.913918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.914079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.914261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.914491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.914857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.915111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.915393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.915561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.915713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.915882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.916036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.916186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.916346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.916559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.916727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.916886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.917047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.917197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.917359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.918143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.918143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.918468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.918468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.918776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.918943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.919104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.919256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.919413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.919572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.919737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.919889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.920059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.920425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.920674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.920674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.920996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.921168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.921395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.921551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.921728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.921970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.922217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.922385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.922583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.922741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.922899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.923049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.923214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.923377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.923528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.923685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.923837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.924001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.924152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.924304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.924454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.924629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.924810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.925059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.925223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.925413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.925658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.925813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.925964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.926125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.926292 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.926463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.926624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.926624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.926923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.927075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.927224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.927374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.927543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.927694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.927858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.928017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.928262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.928424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.928661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.928826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.929121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.929303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.929466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.929631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.930314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.930504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.930771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.931029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.931252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.931439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.931673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.931841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.932092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.932343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.932528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.932744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.932944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.933101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.933263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.933414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.933564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.933564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.933871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.934977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.935245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.935413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.935413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.935830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.936990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.937148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.937300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.937478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.937630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.937789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.937941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.938102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.938282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.938522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.938678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.938829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.938980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.939180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.939333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.939483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.939672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.939859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.940021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.940187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.940340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.940511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.940681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.940842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.941007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.941169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.941327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.941487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.941675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.941913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.942102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.942345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.942584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.942797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.942963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.943115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.943277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.943429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.943595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.943754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.943913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.944083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.944246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.944407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.944614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.944768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.944918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.945082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.945252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.945582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.945856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.946248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.946469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.946639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.946803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.946955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.947116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.947276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.947438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.947672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.947827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.947986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.948201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.948367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.948556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.948800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.948960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.949137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.949288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.949288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.949587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.949739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.949896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.950047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.950205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.950357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.950530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.950686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.950846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.951009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.951168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.951327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.951489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.951642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.951800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.952050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.952209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.952521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.952834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.953948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.954106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.954265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.954418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.954578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.954731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.954881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.955039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.955191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.955350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.955967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.956147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.956404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.956587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.956752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.956906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.957147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.957305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.957465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.957624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.957776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.957973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.958138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.958302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.958461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.958622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.958792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.959982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.960143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.960303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.960534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.960694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.960845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.961015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.961744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.961971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.962364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.963990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.964155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.964317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.964496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.964657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.964819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.964973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.965134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.965295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.965454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.965606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.965775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.966027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.966206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.966368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.966640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.966812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.966965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.967125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.967280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.967439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.967592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.967750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.967903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.968063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.968235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.968402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.968598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.968782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.969227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.969400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.969553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.969713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.969867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.970967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.971284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.971450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.971603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.971762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.971915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.972080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.972233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.972495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.973117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.973300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.973462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.973631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.973792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.973944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.974103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.974262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.974413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.974579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.974733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.974884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.975043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.975205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.975357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.975521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.975675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.975834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.976003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.976239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.976411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.976628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.976949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.977200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.977464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.977735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.978095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.978257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.978410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.978410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.978706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.978859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.979019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.979197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.979431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.979674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.979843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.980006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.980169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.980333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.983219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.983417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.983597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.983766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.983930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.984086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.984238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.984390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.984597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.984777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.984929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.985081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.985254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.985408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.985559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.985726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.985879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.986038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.986207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.986447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.986604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.986771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.986950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.987196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.987365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.987526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.988240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.988416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.988608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.988764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.988915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.989075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.989241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.989422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.989663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.989832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.989983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.990154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.990317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.990478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.990637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.990788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.990938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.991101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.991448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.991619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.991772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.991924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.992082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.992244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.993071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.993071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.993876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.994038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.994200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.994439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.994597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.994756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.994917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.995069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.995228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.995390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.995543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.995718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.995879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.996030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.996196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.996358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.996640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.996812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.996964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.997125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.997386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.997386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.997692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.997865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.998960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.999112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.999263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.999422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.999574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:53.999821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.000993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.001164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.001325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.001485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.001641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.001800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.002060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.002259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.002414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.002566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.002718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.002878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.003032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.003192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.003192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.003753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.003916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.004084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.004244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.004408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.004661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.004825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.004979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.005142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.005304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.005457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.005608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.005764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.005915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.006085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.006251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.006412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.006575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.006833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.007007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.007173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.007340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.007607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.007772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.007989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.008229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.008515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.008723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.008890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.009051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.009226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.009393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.009546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.009697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.009948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.010115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.010269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.010431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.010592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.010744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.010896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.011962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.012127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.012287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.012449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.012624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.012778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.012928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.013099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.013263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.013425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.013597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.013982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.014142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.014311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.014465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.014629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.014789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.014950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.015116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.015278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.015438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.015438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.015749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.015909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.016077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.016239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.016397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.016619 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.016808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.017039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.017207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.017361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.017512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.017768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.017951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.018112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.018346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.018502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.018655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.018806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.018965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.019127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.019287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.019439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.019590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.019742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.019930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.020169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.020327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.020497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.020658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.020821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.020982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.021148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.021300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.021458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.021620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.021780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.021945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.022124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.022277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.022427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.022579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.022738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.022906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.023066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.023229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.023381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.024320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.024609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.024893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.025106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.025283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.025437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.025590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.025740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.025905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.026067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.026227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.026388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.026549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.026710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.026863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.027043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.027301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.027459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.027620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.027807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.028064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.028224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.028378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.028561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.028722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.028903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.029182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.029375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.029573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.029764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.029939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.030093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.030332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.030491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.030644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.030804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.030973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.031139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.031293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.031444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.031605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.031769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.031938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.032104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.032256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.032416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.032633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.032799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.032993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.033159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.033320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.033472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.033472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.033786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.033947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.034100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.034496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.034658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.034810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.034973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.035125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.035285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.035439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.035591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.035756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.035918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.036081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.036245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.036245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.036579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.036750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.036910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.037063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.037215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.037458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.037626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.037793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.037959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.038224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.038393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.038554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.038708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.038870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.039022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.039225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.039425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.039425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.039924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.041011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.041194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.041359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.041513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.041681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.041842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.042962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.043140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.043352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.043515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.043515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.043816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.043968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.044129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.044283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.044746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.044911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.045064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.045229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.045395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.045559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.045721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.045882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.046976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.047139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.047291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.047479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.047727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.047887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.048054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.048054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.048466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.048657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.049988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.050298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.050465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.050619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.050875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.051036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.051036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.051335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.051571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.051735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.051894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.052057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.052222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.052384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.052581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.052751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.052904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.053987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.054140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.054311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.054477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.055499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.055499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.056093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.056333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.056525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.056686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.056839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.056992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.057156 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.057324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.057484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.057668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.057930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.058129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.058284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.058465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.058725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.058882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.059034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.059190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.059350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.059518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.059672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.059831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.060009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.060174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.060327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.060533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.060706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.060706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.061093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.061251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.061413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.061567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.061719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.061880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.062061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.062360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.062536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.062690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.062911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.063069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.063221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.063372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.063538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.063701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.063944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.064112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.064281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.064447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.064627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.064743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.065967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.066915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.067956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.068150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.068279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.068401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.068572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.076954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.077950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.078763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.079949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.080978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081379 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.081962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.082956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.083963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.084931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.085928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.086540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.086540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.087009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.087009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.088928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.089977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.090994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.091986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.092999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.093978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.094937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095144 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.095959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.096995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.097949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.098438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.099994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.100676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.101326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.101326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 15:08:54.101326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 15:08:54.135901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO dbcounter [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Registered counter for database nova_api Sep 19 15:08:54.151782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO dbcounter [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Registered counter for database nova_api Sep 19 15:08:54.156245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.163324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writer thread running {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.173026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_db.sqlalchemy.engines [None req-b472b981-df17-40a1-97ea-6823912a982a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.179818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writer thread running {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.226118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.context [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fad812d-08ce-4e89-9888-006021c91877(cell1) {{(pid=121178) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 15:08:54.231130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:54.231645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:54.233312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:54.234130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:54.240327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:54.240327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:54.241341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.context [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fad812d-08ce-4e89-9888-006021c91877(cell1) {{(pid=121177) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 15:08:54.241449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO dbcounter [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Registered counter for database nova_cell0 Sep 19 15:08:54.241561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:54.241853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:54.244121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO dbcounter [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Registered counter for database nova_cell1 Sep 19 15:08:54.244252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:54.244807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:08:54.245265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:08:54.247323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:08:54.249781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO dbcounter [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Registered counter for database nova_cell0 Sep 19 15:08:54.253519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.254026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO dbcounter [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Registered counter for database nova_cell1 Sep 19 15:08:54.255255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.260595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writer thread running {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.261936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_db.sqlalchemy.engines [None req-b472b981-df17-40a1-97ea-6823912a982a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.263802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_db.sqlalchemy.engines [None req-b472b981-df17-40a1-97ea-6823912a982a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.270055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writer thread running {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.272161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writer thread running {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.404120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writer thread running {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.413065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO dbcounter [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Registered counter for database nova_cell0 Sep 19 15:08:54.420632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_db.sqlalchemy.engines [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.424963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writer thread running {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.425088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO dbcounter [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Registered counter for database nova_cell0 Sep 19 15:08:54.434040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_db.sqlalchemy.engines [None req-b472b981-df17-40a1-97ea-6823912a982a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 15:08:54.438620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writer thread running {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 15:08:54.753075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: WARNING keystonemiddleware.auth_token [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:08:54.761050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: WARNING keystonemiddleware.auth_token [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:08:54.768959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: WARNING keystonemiddleware.auth_token [None req-b472b981-df17-40a1-97ea-6823912a982a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:08:54.776594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: WARNING keystonemiddleware.auth_token [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:08:55.112936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: WARNING keystonemiddleware.auth_token [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:08:55.119772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: WARNING keystonemiddleware.auth_token [None req-7cb8f252-aaf1-4833-bd66-d7243298a142 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:08:55.125152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56086f19a9c0 pid: 121178 (default app) Sep 19 15:08:55.128408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: WARNING keystonemiddleware.auth_token [None req-b472b981-df17-40a1-97ea-6823912a982a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 15:08:55.134978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: WARNING keystonemiddleware.auth_token [None req-b472b981-df17-40a1-97ea-6823912a982a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 15:08:55.140434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56086f19a9c0 pid: 121177 (default app) Sep 19 15:09:29.942828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:29.942828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:29.942828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:29.942828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:31.244863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-368c80ef-702e-40fa-8de8-d58da53d1a15 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Action: 'create', calling method: .version_select at 0x7f41fc4734c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-171972647"}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:33.293851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-368c80ef-702e-40fa-8de8-d58da53d1a15 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.369357 Sep 19 15:09:33.295633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1155 bytes} [Mon Sep 19 15:09:29 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3373 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 15:09:33.319509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:33.327544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:33.327544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:33.327544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:09:33.714024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b9202fd-e39a-46a7-ba75-8babb6649a68 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc4bb160>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:34.559795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b9202fd-e39a-46a7-ba75-8babb6649a68 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 200 len: 344 microversion: 2.1 time: 1.245397 Sep 19 15:09:34.567695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1/2] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:33 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 344 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:35.578986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-374ffbd7-f92d-45fe-90a9-2d57e81b8fbf tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc3463a0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:35.855921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-374ffbd7-f92d-45fe-90a9-2d57e81b8fbf tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 200 len: 345 microversion: 2.1 time: 0.282532 Sep 19 15:09:35.864915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:35 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 345 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:35.871898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6448555-da1a-4eec-83b6-8cd14756c4cb tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Action: 'create', calling method: .version_select at 0x7f41fc384280>, body: {"snapshot": {"volume_id": "2459cdeb-7b46-4d7a-a153-8113b02e8bbe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-274987050"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:36.758098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d6448555-da1a-4eec-83b6-8cd14756c4cb tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.891167 Sep 19 15:09:36.758678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 2/4] 10.222.0.75 () {60 vars in 1162 bytes} [Mon Sep 19 15:09:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:36.770076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bc0fbd47-1b34-4edd-9315-0a180bdeb866 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc346a60>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:36.849309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bc0fbd47-1b34-4edd-9315-0a180bdeb866 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.082951 Sep 19 15:09:36.849862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 3/5] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:36 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:36.862030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6e75c281-b9a0-4b53-9600-b6e73c4e770b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc353160>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:36.935353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6e75c281-b9a0-4b53-9600-b6e73c4e770b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.077136 Sep 19 15:09:36.937738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 3/6] 10.222.0.75 () {58 vars in 1140 bytes} [Mon Sep 19 15:09:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:09:36.950267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-79d0deff-07e9-4b0a-b5b1-95bcc12971e4 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2df1f0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:37.015840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-79d0deff-07e9-4b0a-b5b1-95bcc12971e4 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.070158 Sep 19 15:09:37.016618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:36 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:38.029487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3f55183f-0469-45f2-83b3-c77a435221c9 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2d7550>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:38.081962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3f55183f-0469-45f2-83b3-c77a435221c9 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.056180 Sep 19 15:09:38.087995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:38 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:39.095568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ea5e88e0-4cbc-4949-b473-496c58153955 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc346b80>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:39.151108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ea5e88e0-4cbc-4949-b473-496c58153955 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.059697 Sep 19 15:09:39.151666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 5/9] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:39 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:40.163632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f60064a3-c4a7-499a-a78c-1b3cb229d1ed tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc353790>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:40.214004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f60064a3-c4a7-499a-a78c-1b3cb229d1ed tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.054457 Sep 19 15:09:40.214924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 5/10] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:40 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:41.228112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-13a4e7d3-f893-4613-96b6-5574cf7b8d13 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc3464c0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:41.297606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-13a4e7d3-f893-4613-96b6-5574cf7b8d13 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.074828 Sep 19 15:09:41.303784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 6/11] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:41 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:42.311531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0f259659-07b9-46e8-889c-4616eeca8647 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc353040>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:42.360912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0f259659-07b9-46e8-889c-4616eeca8647 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.053224 Sep 19 15:09:42.361481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:42 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:43.378342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-284fccab-0872-4ae4-ab5a-66ab4d2f210a tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2df310>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:43.424725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-284fccab-0872-4ae4-ab5a-66ab4d2f210a tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.051983 Sep 19 15:09:43.425288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:43 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:44.443371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d894a946-8fff-418e-84cf-21f1d99f13ca tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fcc9faf0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:44.517356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d894a946-8fff-418e-84cf-21f1d99f13ca tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.082732 Sep 19 15:09:44.518511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 7/14] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:44 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:45.542972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b2b3d245-b0d0-43dd-88b4-6ea6f1ec5c64 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2df8b0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:45.642206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b2b3d245-b0d0-43dd-88b4-6ea6f1ec5c64 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 287 microversion: 2.1 time: 0.112820 Sep 19 15:09:45.646757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 8/15] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:45 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:45.661047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-413b62cd-b773-4bc7-b324-2e6e26895828 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc3463a0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:45.844505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a3877be-708d-49a1-be4f-352b1326c8dc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Action: 'create', calling method: .version_select at 0x7f41fc353af0>, body: {"keypair": {"name": "tempest-keypair-1911129086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMJyF1zRlzFphdewA/hQzpKEn88P4wNFM2PPZuvSs5wtdjrmzxsueMlcW50GZLoKjWMwH20qQC7I+wiWCKs6GaM3WTB2zi/kUSkKeYCi7dGAxMymrsj4cOME5dQl0/c9Q=="}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:45.868962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-413b62cd-b773-4bc7-b324-2e6e26895828 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 202 len: 0 microversion: 2.1 time: 0.212726 Sep 19 15:09:45.868962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 9/16] 10.222.0.75 () {58 vars in 1254 bytes} [Mon Sep 19 15:09:45 2022] DELETE /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:09:45.872959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d715b8f2-e191-44e3-be49-1cbd018c241d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc346a60>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:45.936244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d715b8f2-e191-44e3-be49-1cbd018c241d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 200 len: 286 microversion: 2.1 time: 0.059081 Sep 19 15:09:45.936244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 10/17] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:45 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:09:45.955163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-7a3877be-708d-49a1-be4f-352b1326c8dc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for project c727384d4ff043809f8421840cbd7596. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:45.975850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-7a3877be-708d-49a1-be4f-352b1326c8dc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for user 833edf46ef9b4d3982ce49abc74933a2 and project c727384d4ff043809f8421840cbd7596. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:46.050009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1121484854", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "networks": [{"uuid": "fa450327-0e5e-4b61-907a-a14dc4ce2db9"}]}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:46.178718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7a3877be-708d-49a1-be4f-352b1326c8dc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.618207 Sep 19 15:09:46.180514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 8/18] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:09:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:46.265533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] validate_networks() for [('fa450327-0e5e-4b61-907a-a14dc4ce2db9', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:09:46.942442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8ce9800f-2f17-4866-97f3-543d9cc147ad tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2b8a60>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:47.012762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-8ce9800f-2f17-4866-97f3-543d9cc147ad tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] HTTP exception thrown: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8ce9800f-2f17-4866-97f3-543d9cc147ad tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Request method failure captured: Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc HTTP/1.1 Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIYpCHdy04aZjW6zd2tGJ1lcoNTyRSTRHKslb6eoEXsTDauzy7VZePzrqNMQkVP8MmtgJuTPhB73-uNFYx1rHA9H6Q5Bv77BNzuO1A0tMvNtV7ITMtmmyFtoF5LhNElY_8O4OVdn-kV-OjGOnSPrzfNupiS4SAd25lXPvOMR4kUV-FA Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:09:47.018438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8b147e8b476c4e59badeacbd573973ab"}]}] Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 125691945edf41e39d74c7258d375c85 Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '314e4d9e-2237-483e-bc41-33073b69c5cc'} Sep 19 15:09:47.019782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. (HTTP 404) (Request-ID: req-cc9c5dca-54d0-4d8c-bd7a-d7ec99c28ed3) Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.020578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:09:47.021787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 15:09:47.023862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8ce9800f-2f17-4866-97f3-543d9cc147ad tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Returning 404 to user: Snapshot 314e4d9e-2237-483e-bc41-33073b69c5cc could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8ce9800f-2f17-4866-97f3-543d9cc147ad tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc" status: 404 len: 111 microversion: 2.1 time: 0.081908 Sep 19 15:09:47.027011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 9/19] 10.222.0.75 () {58 vars in 1251 bytes} [Mon Sep 19 15:09:46 2022] GET /compute/v2.1/os-snapshots/314e4d9e-2237-483e-bc41-33073b69c5cc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:09:47.042901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c4bdf0b0-acf0-40ac-a4b7-5e7587a9a146 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc21af70>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:47.370672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c4bdf0b0-acf0-40ac-a4b7-5e7587a9a146 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 202 len: 0 microversion: 2.1 time: 0.340511 Sep 19 15:09:47.372668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 10/20] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:09:47 2022] DELETE /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:09:47.385250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fb66440f-aa45-4477-b431-46f8eaae38f8 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc353790>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:47.514221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fb66440f-aa45-4477-b431-46f8eaae38f8 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 200 len: 344 microversion: 2.1 time: 0.135868 Sep 19 15:09:47.514796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 11/21] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:47 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:48.170981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:09:48.180630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:09:48.180630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:09:48.180630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:09:48.180630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:09:48.221372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:48.221877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:48.224915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:48.225774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:48.229141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:48.230912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:48.330128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Getting quotas for project ef0871bc1c2b4276afb1d8ad77fda839. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:48.339704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Getting quotas for user 6452ad1301fb4f2aa2f0c015463455c4 and project ef0871bc1c2b4276afb1d8ad77fda839. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:48.381470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:09:48.392253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:09:48.529755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9c0d1e8e-ec2b-43dc-8a32-79b2f974952f tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2481f0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:48.645099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-61168358-66db-4639-87df-d645339498c3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.712322 Sep 19 15:09:48.647046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 11/22] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:09:48.658414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9c0d1e8e-ec2b-43dc-8a32-79b2f974952f tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 200 len: 344 microversion: 2.1 time: 0.132447 Sep 19 15:09:48.667722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 12/23] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:48 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:48.674740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-eb3f3235-fa40-41a8-a2a9-ab3015e3854a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:48.677872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-eb3f3235-fa40-41a8-a2a9-ab3015e3854a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:49.047552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-eb3f3235-fa40-41a8-a2a9-ab3015e3854a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:49.077543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-eb3f3235-fa40-41a8-a2a9-ab3015e3854a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1215 microversion: 2.1 time: 0.408157 Sep 19 15:09:49.079152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 12/24] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:48 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1215 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:49.673894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6e6faaab-4ff7-4775-871e-6d693c5cc7a8 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fba0b550>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:49.823113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6e6faaab-4ff7-4775-871e-6d693c5cc7a8 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 200 len: 344 microversion: 2.1 time: 0.152849 Sep 19 15:09:49.823688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 13/25] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:49 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:09:50.102093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-149d87bd-2a5a-419f-8e00-bdc693756e2a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:50.102636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-149d87bd-2a5a-419f-8e00-bdc693756e2a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:50.194451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-149d87bd-2a5a-419f-8e00-bdc693756e2a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:50.203389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-149d87bd-2a5a-419f-8e00-bdc693756e2a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1215 microversion: 2.1 time: 0.105072 Sep 19 15:09:50.206102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 14/26] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:50 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:09:50.750682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4f9b4956-5201-4eb8-837e-b5bc6cc8bc00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: .version_select at 0x7f41fc248820>, body: {"keypair": {"name": "tempest-keypair-356085505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICMUT/c3Kelr9XPh/m6rQpDkWgjOC1zkDOWr27o5/XFccOKkS9ZB4qq7KUO3eqgKytDbEv7Yoy6pAvVMy3Bfz0gNA0lH9yHr6U8VSa3Z9VQKINAhzduvveK529IM1GphQ=="}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:50.805309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-4f9b4956-5201-4eb8-837e-b5bc6cc8bc00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:50.837943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-4f9b4956-5201-4eb8-837e-b5bc6cc8bc00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:50.890244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-930d5808-8f4e-453c-ad3d-2e37edb68ebd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Action: 'create', calling method: .version_select at 0x7f41fba12ca0>, body: {"keypair": {"name": "tempest-keypair-154904036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvlfLPye9Xj14WPjldhIXZPTW9E6YvcNTdpaDjB0+omz0DQ41bwqR3Q+hQnl3cbS81WeHOLLXqbio1n6I8/58TejRsow0RrQ/a011MBI6knb3nCoIy3kKL4nc8ydD3kdA=="}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:50.945608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-930d5808-8f4e-453c-ad3d-2e37edb68ebd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:50.956375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-930d5808-8f4e-453c-ad3d-2e37edb68ebd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for user 808156c7457b4e8b9b6c5f305755b3f3 and project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:50.977464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4f9b4956-5201-4eb8-837e-b5bc6cc8bc00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.347083 Sep 19 15:09:50.978193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 13/27] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:09:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:50.985930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4bf57a73-b2fd-4e16-ab68-0a5fee10b181 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc2481f0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:51.142977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4bf57a73-b2fd-4e16-ab68-0a5fee10b181 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 200 len: 344 microversion: 2.1 time: 0.163182 Sep 19 15:09:51.143737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 14/28] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:50 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:09:51.172403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-930d5808-8f4e-453c-ad3d-2e37edb68ebd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.528954 Sep 19 15:09:51.182373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 15/29] 10.222.0.75 () {62 vars in 1200 bytes} [Mon Sep 19 15:09:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 539 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 15:09:51.232878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f236b1e6-4c8f-44b1-afbd-d41e0ea75950 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:51.233909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f236b1e6-4c8f-44b1-afbd-d41e0ea75950 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:51.385454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f236b1e6-4c8f-44b1-afbd-d41e0ea75950 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:51.424733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f236b1e6-4c8f-44b1-afbd-d41e0ea75950 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1215 microversion: 2.1 time: 0.182755 Sep 19 15:09:51.425789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 15/30] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:51 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:52.157793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7222638e-683f-4e51-b63e-c18d71ca9f82 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fb99e040>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:52.213907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-7222638e-683f-4e51-b63e-c18d71ca9f82 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] HTTP exception thrown: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7222638e-683f-4e51-b63e-c18d71ca9f82 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Request method failure captured: Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe HTTP/1.1 Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIYpCHdy04aZjW6zd2tGJ1lcoNTyRSTRHKslb6eoEXsTDauzy7VZePzrqNMQkVP8MmtgJuTPhB73-uNFYx1rHA9H6Q5Bv77BNzuO1A0tMvNtV7ITMtmmyFtoF5LhNElY_8O4OVdn-kV-OjGOnSPrzfNupiS4SAd25lXPvOMR4kUV-FA Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:09:52.218589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8b147e8b476c4e59badeacbd573973ab"}]}] Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 125691945edf41e39d74c7258d375c85 Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '2459cdeb-7b46-4d7a-a153-8113b02e8bbe'} Sep 19 15:09:52.219922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. (HTTP 404) (Request-ID: req-30a90378-1c2d-4258-90f7-9bb545499d83) Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.220741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:09:52.221910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:09:52.223353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.224500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7222638e-683f-4e51-b63e-c18d71ca9f82 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Returning 404 to user: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:52.225240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7222638e-683f-4e51-b63e-c18d71ca9f82 tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 404 len: 109 microversion: 2.1 time: 0.069461 Sep 19 15:09:52.235390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 16/31] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:52 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:09:52.241133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eb1cb5c9-3d9c-4dba-b5a8-b5a5a605d59b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fc1f4160>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:52.286595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-eb1cb5c9-3d9c-4dba-b5a8-b5a5a605d59b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] HTTP exception thrown: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eb1cb5c9-3d9c-4dba-b5a8-b5a5a605d59b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Request method failure captured: Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe HTTP/1.1 Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIYpCHdy04aZjW6zd2tGJ1lcoNTyRSTRHKslb6eoEXsTDauzy7VZePzrqNMQkVP8MmtgJuTPhB73-uNFYx1rHA9H6Q5Bv77BNzuO1A0tMvNtV7ITMtmmyFtoF5LhNElY_8O4OVdn-kV-OjGOnSPrzfNupiS4SAd25lXPvOMR4kUV-FA Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:09:52.290370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8b147e8b476c4e59badeacbd573973ab"}]}] Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 125691945edf41e39d74c7258d375c85 Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '2459cdeb-7b46-4d7a-a153-8113b02e8bbe'} Sep 19 15:09:52.291839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. (HTTP 404) (Request-ID: req-2d5dbe3a-18b3-41a9-8efc-7700e689e2b8) Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.292981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:09:52.294442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 15:09:52.295693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eb1cb5c9-3d9c-4dba-b5a8-b5a5a605d59b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Returning 404 to user: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:52.300608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-eb1cb5c9-3d9c-4dba-b5a8-b5a5a605d59b tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 404 len: 109 microversion: 2.1 time: 0.063320 Sep 19 15:09:52.302243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 16/32] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:09:52 2022] DELETE /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:09:52.320366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ae8399a9-efc9-45e1-9566-16357780853d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Calling method '.version_select at 0x7f41fb976d30>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:52.386943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-ae8399a9-efc9-45e1-9566-16357780853d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] HTTP exception thrown: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ae8399a9-efc9-45e1-9566-16357780853d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Request method failure captured: Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe HTTP/1.1 Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIYpCHdy04aZjW6zd2tGJ1lcoNTyRSTRHKslb6eoEXsTDauzy7VZePzrqNMQkVP8MmtgJuTPhB73-uNFYx1rHA9H6Q5Bv77BNzuO1A0tMvNtV7ITMtmmyFtoF5LhNElY_8O4OVdn-kV-OjGOnSPrzfNupiS4SAd25lXPvOMR4kUV-FA Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:09:52.390041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8b147e8b476c4e59badeacbd573973ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8b147e8b476c4e59badeacbd573973ab"}]}] Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 8b147e8b476c4e59badeacbd573973ab Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725259107 Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 125691945edf41e39d74c7258d375c85 Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725259107-project Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '2459cdeb-7b46-4d7a-a153-8113b02e8bbe'} Sep 19 15:09:52.391363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. (HTTP 404) (Request-ID: req-6848d0f2-84e5-48cd-8759-8df729efcb4c) Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.392152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:09:52.393321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:09:52.395002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:09:52.396342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ae8399a9-efc9-45e1-9566-16357780853d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] Returning 404 to user: Volume 2459cdeb-7b46-4d7a-a153-8113b02e8bbe could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:09:52.401517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ae8399a9-efc9-45e1-9566-16357780853d tempest-VolumesSnapshotsTestJSON-725259107 tempest-VolumesSnapshotsTestJSON-725259107-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe" status: 404 len: 109 microversion: 2.1 time: 0.089413 Sep 19 15:09:52.401517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 17/33] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:09:52 2022] GET /compute/v2.1/os-volumes/2459cdeb-7b46-4d7a-a153-8113b02e8bbe => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:09:52.453496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:52.454487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:52.466099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:52.473421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:52.474711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:52.479124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:52.482840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:52.483932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:52.859771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:52.883489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d6614139-908a-4e49-9278-9f89929d1f7f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1211 microversion: 2.1 time: 0.435179 Sep 19 15:09:52.889430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 17/34] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:52 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1211 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:53.407070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1123519091", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f91a6788-cbf8-4d13-afa8-871086d6f4e4"}], "security_groups": [{"name": "tempest-securitygroup--2090611212"}], "key_name": "tempest-keypair-1911129086", "user_data": "}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:53.911956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] validate_networks() for [('f91a6788-cbf8-4d13-afa8-871086d6f4e4', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:09:53.919015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:53.919802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:53.932178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:53.932731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:53.934480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:53.935327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:53.935857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:53.936356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:54.125737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:54.141601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1b19f311-3445-454b-983e-66193e3008c8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1267 microversion: 2.1 time: 0.228765 Sep 19 15:09:54.148615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 18/35] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:53 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:09:55.166356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:55.167512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:55.190822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:55.196925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:55.202060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:55.202060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:55.202060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:55.202531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:55.748511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:55.770650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d316bd1b-f4a4-4dd4-9092-5750010fc3dd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1273 microversion: 2.1 time: 0.608892 Sep 19 15:09:55.775853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 19/36] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:55 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1273 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:09:56.114720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:09:56.115797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:09:56.117077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:09:56.117741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:09:56.118312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:09:56.137040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:56.139048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:56.139708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:56.143868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:56.144811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:56.145623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:56.196380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for project c727384d4ff043809f8421840cbd7596. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:56.203220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for user 833edf46ef9b4d3982ce49abc74933a2 and project c727384d4ff043809f8421840cbd7596. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:56.206230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1799288604", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ff7392-2bca-4e1a-a6d9-bcf3e1581d76"}], "security_groups": [{"name": "tempest-securitygroup--1489670049"}], "key_name": "tempest-keypair-154904036", "user_data": "}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:56.234880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:09:56.239635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:09:56.495485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7c4997a3-2db4-4c22-b5cb-98a3628c2161 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.095551 Sep 19 15:09:56.496160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:09:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:09:56.517852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d939afd4-2f01-4a35-9ff7-61e5371364bd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:56.520468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d939afd4-2f01-4a35-9ff7-61e5371364bd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:56.774104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d939afd4-2f01-4a35-9ff7-61e5371364bd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:56.785491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d939afd4-2f01-4a35-9ff7-61e5371364bd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1238 microversion: 2.1 time: 0.279455 Sep 19 15:09:56.786113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 19/38] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:56 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1238 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:09:56.810843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:56.811820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:56.832713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:56.834192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:56.838767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:56.839775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:56.840549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:56.841290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:57.182184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] validate_networks() for [('67ff7392-2bca-4e1a-a6d9-bcf3e1581d76', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:09:57.712155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:09:57.749259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4b9a0e98-abc5-4505-a5d1-ed8594d7f35a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1273 microversion: 2.1 time: 0.950635 Sep 19 15:09:57.750355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 20/39] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:56 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1273 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:09:57.768747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1439848092", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117"}], "security_groups": [{"name": "tempest-securitygroup--1480329329"}], "key_name": "tempest-keypair-356085505", "user_data": "}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:09:58.062102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] validate_networks() for [('bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:09:59.397011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:09:59.402494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:09:59.402494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:09:59.402494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:09:59.402494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:09:59.424180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:59.425639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:59.426363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:59.427377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:59.428129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:59.429522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:59.495401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:09:59.501405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:09:59.539454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:09:59.547159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:09:59.817559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ba40df4-df3d-41df-86f3-cdd8305448e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.063866 Sep 19 15:09:59.829279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:09:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:09:59.838612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:09:59.846677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:09:59.886784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:59.887301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:59.887747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:09:59.899949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:09:59.902065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:09:59.902528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.047681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:01.062022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ef705e43-4ce3-42d6-9811-d691c7880a39 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1242 microversion: 2.1 time: 1.236215 Sep 19 15:10:01.064073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 22/41] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:09:59 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1242 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:01.076174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:01.084633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:01.095955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:01.096630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:01.097339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.098515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:01.099321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:01.101816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.402772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=10 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:01.641440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:10:01.642919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:10:01.644558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:10:01.649583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:10:01.649583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:10:01.690407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:01.696718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:01.697670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.699664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:01.705616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:01.706571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.785874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:01.796137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e0bbef6c-6d9b-4d5b-bd1f-84de395bf80e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.730628 Sep 19 15:10:01.801407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 23/42] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:01 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:01.819936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:01.830339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:01.838726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:10:01.855319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for user 808156c7457b4e8b9b6c5f305755b3f3 and project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:10:01.857923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:01.858418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:01.874486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.880041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:01.884506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:01.887609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:01.917523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:10:01.928301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:10:02.043296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:02.056434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4586cbb9-e1e8-4d29-bc76-f93e4d03ba1c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1245 microversion: 2.1 time: 0.253660 Sep 19 15:10:02.058706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 24/43] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1245 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:02.121717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:02.142135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:02.161077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:02.161496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:02.161942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:02.162655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:02.186433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:02.187199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:02.231017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-50ae79a1-663b-4934-a3eb-f5300e63eed2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.031166 Sep 19 15:10:02.249250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 20/44] 10.222.0.75 () {62 vars in 1188 bytes} [Mon Sep 19 15:09:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 6050 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 15:10:02.296378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-348fea30-a5f2-4e61-9fe0-efeb541a9f33 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:02.297056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-348fea30-a5f2-4e61-9fe0-efeb541a9f33 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:02.549364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:02.561817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b45c8bc-6fb5-4b0f-8e34-06e01f5f4762 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1298 microversion: 2.1 time: 0.444087 Sep 19 15:10:02.565134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 25/45] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:02 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1298 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:02.573090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-348fea30-a5f2-4e61-9fe0-efeb541a9f33 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:02.600040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-348fea30-a5f2-4e61-9fe0-efeb541a9f33 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:02.618643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-348fea30-a5f2-4e61-9fe0-efeb541a9f33 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:02.621714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-348fea30-a5f2-4e61-9fe0-efeb541a9f33 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1281 microversion: 2.20 time: 0.368879 Sep 19 15:10:02.623324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 21/46] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:02 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:02.827808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:02.828513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:02.842306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:02.844044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:02.844578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:02.846759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:02.848870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:02.850343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:03.087215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:03.089262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:03.114270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:03.115668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:03.121297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:03.124192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:03.124192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:03.124192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:03.463267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:03.477499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a7cd09ea-a2c3-4f39-92f5-c2f6dd696e56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1293 microversion: 2.1 time: 0.396357 Sep 19 15:10:03.479257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 22/47] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1293 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:03.559177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:03.573964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2582e310-5d10-45ee-999b-d6c21cf348e2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.750605 Sep 19 15:10:03.574967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 26/48] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:02 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:03.596819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:03.598405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:03.609581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:03.619537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:03.619991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:03.624321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:03.625545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:03.626003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:03.648612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-161ab701-70b2-4bec-8408-6fed0afa62e3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:03.649469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-161ab701-70b2-4bec-8408-6fed0afa62e3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:03.999148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-161ab701-70b2-4bec-8408-6fed0afa62e3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:04.010769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-161ab701-70b2-4bec-8408-6fed0afa62e3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:04.018340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-161ab701-70b2-4bec-8408-6fed0afa62e3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:04.019584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-161ab701-70b2-4bec-8408-6fed0afa62e3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1281 microversion: 2.20 time: 0.375777 Sep 19 15:10:04.020737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 27/49] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:03 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1281 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:04.034373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:04.066829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-27d48c11-470c-4027-b82a-5b4997652271 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1296 microversion: 2.1 time: 0.470389 Sep 19 15:10:04.066829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 23/50] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:03 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1296 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:04.511897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:04.512947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:04.524722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.527527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:04.530583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:04.531698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.532513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:04.535366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:04.834374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:04.892560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6176307d-1ba6-4360-856c-13d9f8910146 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1301 microversion: 2.1 time: 0.351621 Sep 19 15:10:04.910524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 24/51] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1301 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:04.929870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:04.930977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:04.971120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1889b4f-b5a8-45d3-ad20-cbb9566c46a8", "tag": "eaac7458-d66b-4bba-87e3-a6776b60728b"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:04.995504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:04.996089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.002473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.018171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.018171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.018171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.059665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.060211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.060702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.151450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Creating event network-changed:eaac7458-d66b-4bba-87e3-a6776b60728b for instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 on hv-cinder-75671 Sep 19 15:10:05.152002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 15:10:05.152392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b544842d-c62d-4c36-92e6-7a4cbd005b51 req-7b8d3a65-3107-47fb-a80d-1d268e9fda88 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 15:10:05.153590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.174375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.175923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.177521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.178337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.179521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.192192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.compute.rpcapi [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 15:10:05.193321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] Releasing lock "compute-rpcapi-router" {{(pid=121178) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 15:10:05.216392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7e9b7047-0eac-49f7-b7d7-fd18c7a9421a None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.961445 Sep 19 15:10:05.220909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 28/52] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:05.234486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:05.235663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:05.246925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.247598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.248320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.249083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.249536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.249958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.816098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:05.839585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:05.843286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:05.855182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d548e781-9ce7-44a1-b57a-dc6447b179e1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1333 microversion: 2.20 time: 0.632042 Sep 19 15:10:05.862708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 29/53] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:05 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1333 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:05.876281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:05.877302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:05.895695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.901273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.903139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:05.905355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:05.906671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:05.907822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.166291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:06.178368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f45a9ba5-da48-44ad-86f1-dc6f934df9d3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 1.260855 Sep 19 15:10:06.181150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 25/54] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:04 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:06.206429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:06.209458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:06.224374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.225196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.226768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.227702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.232232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.232935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.344471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:06.355224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-706a49ef-2b8c-4c57-81e7-f383004bbeb6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.489132 Sep 19 15:10:06.369450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 30/55] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:05 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:06.395724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:06.413319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a82e47d7-b7d0-47e2-b66e-c249ce5d4957 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1299 microversion: 2.1 time: 0.230297 Sep 19 15:10:06.421260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 26/56] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:06.893695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:06.894564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:06.909087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:06.915004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.915567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.916764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:06.917498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:06.917959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:06.918390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.139468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:07.149855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:07.155831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:07.165870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-16ebcaf5-9365-42c7-bba8-ce0b86b4ac3d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1333 microversion: 2.20 time: 0.275962 Sep 19 15:10:07.181076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 31/57] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:06 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1333 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:07.208821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:07.209595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:07.221060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.223753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.228722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.229637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.230448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.233867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.384776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:07.385634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:07.420643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.424090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.424090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.424090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.424090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.424639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.808206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:07.819750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5bb4bf67-f5bc-4aa1-98a2-edf16e81c42d tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.615083 Sep 19 15:10:07.823692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 27/58] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:07 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:07.841059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:07.842021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:07.849424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.850080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.851441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:07.855627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:07.856312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:07.856927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.086118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:08.104394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f796ab2c-14fa-4451-9e3c-0ce2e87c1366 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.725738 Sep 19 15:10:08.107882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 32/59] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:07 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:08.198069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:08.199970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:08.209219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.210842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.212095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.213337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.214330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.215626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.540164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:08.560550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:08.562963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:08.566803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-093fb433-ea9b-45c1-95a8-b6725bef3c4c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1339 microversion: 2.20 time: 0.374749 Sep 19 15:10:08.580699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 33/60] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:08 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1339 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:08.738819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:08.756628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e7a69679-6978-4c5a-9ecc-d9c707755c1f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.931591 Sep 19 15:10:08.760796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 28/61] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:08.848270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:08.848891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:08.881922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.883485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.884043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:08.885370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:08.886388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:08.887109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.135024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:09.135643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:09.154839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.154839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.154839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.155207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.155672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.156097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.216460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.247974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3e1254f0-b09b-4fe5-8799-9439e907fe47 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.403672 Sep 19 15:10:09.268407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 34/62] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:08 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:09.615239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:09.615938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:09.632446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.633271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.633954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.634932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.636376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.637226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.839270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.853217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.855233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.868627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0a6eb096-0cee-4050-b245-1c7d7fbf66c7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1339 microversion: 2.20 time: 0.260559 Sep 19 15:10:09.868627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 35/63] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:09 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:09.920630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:09.932274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b69afb93-8363-4d42-900b-1925e62ad294 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.802183 Sep 19 15:10:09.933489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 29/64] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:09 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:09.938606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:09.939275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:09.950062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.950062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.950062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.950062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.950436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.950436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.954841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-68a8912d-a46f-4a57-a105-dfb95664e56b req-10ae52d0-f340-4ef1-8af7-5b6521defab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a37d13a-b506-47f9-9473-9263fa583258", "tag": "09b225b1-fd59-4d43-934b-bf41d463c818"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:09.964787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-68a8912d-a46f-4a57-a105-dfb95664e56b req-10ae52d0-f340-4ef1-8af7-5b6521defab9 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:09.965514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-68a8912d-a46f-4a57-a105-dfb95664e56b req-10ae52d0-f340-4ef1-8af7-5b6521defab9 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:09.966212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-68a8912d-a46f-4a57-a105-dfb95664e56b req-10ae52d0-f340-4ef1-8af7-5b6521defab9 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:09.987497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-68a8912d-a46f-4a57-a105-dfb95664e56b req-10ae52d0-f340-4ef1-8af7-5b6521defab9 service nova] Creating event network-changed:09b225b1-fd59-4d43-934b-bf41d463c818 for instance 0a37d13a-b506-47f9-9473-9263fa583258 on hv-cinder-75671 Sep 19 15:10:09.993931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-68a8912d-a46f-4a57-a105-dfb95664e56b req-10ae52d0-f340-4ef1-8af7-5b6521defab9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135774 Sep 19 15:10:09.994836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 36/65] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:10.107735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:10.129609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-aa4cbc55-5865-47a0-a987-c2155e123fd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.183511 Sep 19 15:10:10.129609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 30/66] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:10.281985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:10.282885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:10.290968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.291462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.291938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.294542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.295384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.296121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.532582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:10.544718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4f2836d6-4089-4fef-85b2-b9b2d52a1bb2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.267879 Sep 19 15:10:10.546111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 37/67] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:10 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:10.657266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751262b-7323-4c6a-b3f1-830fb2448558", "tag": "f872e19c-541e-4edf-b7d4-a8a9c1d84150"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:10.671533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.672004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.672423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.693229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Creating event network-changed:f872e19c-541e-4edf-b7d4-a8a9c1d84150 for instance 2751262b-7323-4c6a-b3f1-830fb2448558 on hv-cinder-75671 Sep 19 15:10:10.694962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 15:10:10.695481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a09ff285-24fe-438e-8598-ad47e7fe44c9 req-4e83029b-c9fb-43d1-a905-7e7eb13ee8ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=121177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 15:10:10.696601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.697226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.697663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.698378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.698831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.699252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.708079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.compute.rpcapi [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 15:10:10.708980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] Releasing lock "compute-rpcapi-router" {{(pid=121177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 15:10:10.723881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-03c8fd57-b1f4-4ccf-96ad-7eb274fe0e7f None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070233 Sep 19 15:10:10.724490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 31/68] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:10.882722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:10.883521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:10.889812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.890725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.891371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.892278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.892962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.893712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.915133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:10.961822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:10.962550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:10.972514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.973289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.973867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:10.974609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:10.975971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:10.976412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:11.111091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:11.125267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:11.127347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:11.129055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dcdd95f1-37dc-4839-838c-1f82b32de4ed tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.250166 Sep 19 15:10:11.132288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 38/69] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:10 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:11.153402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:11.154279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:11.161054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:11.165077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:11.168470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:11.169146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:11.169897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:11.170369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:11.170796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:11.172905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9e0c9572-5dd6-4f2b-abdc-191dd202b2c1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.216344 Sep 19 15:10:11.173539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 32/70] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:10 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:11.347156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:11.356146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f8c4c9b2-ee15-4642-8fc5-a17eea45934e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.216698 Sep 19 15:10:11.356803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 39/71] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:11.569742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:11.570380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:11.577394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:11.577894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:11.578338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:11.579250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:11.579889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:11.580952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:11.781265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:11.789306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-35c8f141-5922-4647-acf6-da91ac702cc2 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.223612 Sep 19 15:10:11.789875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 33/72] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:11 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:12.156242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:12.157521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:12.166974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.173400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.173400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.173400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.173400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.174159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.204527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:12.204527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:12.212113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.213087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.213674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.214829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.215453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.216496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.414763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.440168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.445807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.457459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-111215c3-b80b-4b58-927c-196323c06f2d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.296038 Sep 19 15:10:12.457459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 40/73] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:12 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:12.462197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:12.463070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:12.469676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.470192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.470561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.471624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.471959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.472438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.509495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.518359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-23abcc7e-c6b3-4edc-8c28-28dcf2838897 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.319747 Sep 19 15:10:12.520537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 34/74] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:12 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:12.635014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.643338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d2faf7cf-bd93-4013-8aae-9d78bd407b60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.190254 Sep 19 15:10:12.644149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 41/75] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:12.813096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:12.813714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:12.815655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=8 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:12.822916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.823427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.823857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.825398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:12.825870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:12.826305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:12.845351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:12.974139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:12.983242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-11067e80-5767-40d2-91da-37aaca309091 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.174655 Sep 19 15:10:12.983814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 35/76] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:12 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:13.480463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:13.481075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:13.487032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.487493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.487920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.488635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.489083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.489499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.547871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:13.555108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:13.555532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.556197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.556743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.557393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.557885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.558314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.770619 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:13.782204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:13.783881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:13.786456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-29ffcb36-229f-41d1-a360-91dda53cfae6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.310750 Sep 19 15:10:13.787539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 42/77] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:13 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:13.794892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:13.796190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:13.804829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.805492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.806024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.807284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:13.808464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:13.809110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:13.832070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:13.849610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-041dd47f-870c-4179-a619-de6e7673ad6b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.305902 Sep 19 15:10:13.853226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 36/78] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:13 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:14.004382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=30 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:14.008968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:14.009588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:14.018436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:14.019027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:14.019636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:14.026747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:14.026747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:14.026747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:14.071481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:14.083388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9f426c5b-f546-4f13-ab23-80a719a9640a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.293779 Sep 19 15:10:14.083973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 43/79] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:14.266076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:14.277656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cadeb647-811a-4754-afbb-f45398d6c9fd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.273711 Sep 19 15:10:14.278468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 37/80] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:14 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:14.812786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:14.814386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:14.823311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:14.824093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:14.824713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:14.825638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:14.826304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:14.827479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:14.877997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:14.884747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:14.887321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:14.913153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:14.913746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:14.914197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:14.914952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:14.915409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:14.915839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:15.189507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=8 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:15.655891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:15.666082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:15.667545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:15.668700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a691dc04-878f-439a-93c1-d247abfde48a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.861174 Sep 19 15:10:15.673859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 44/81] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:14 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:15.674312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:15.675178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:15.686159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:15.686664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:15.687220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:15.688012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:15.688498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:15.688930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:15.712473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:15.721135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7c151aaa-4c33-449c-9cec-a394fd1782c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.850580 Sep 19 15:10:15.722256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 38/82] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:14 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:15.728186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:15.728822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:15.763531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:15.764288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:15.765174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:15.766049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:15.766651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:15.767240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.055092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:16.077990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bf8d5368-3439-48d5-95ad-65b21aab66fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.407336 Sep 19 15:10:16.083132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 45/83] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:16.113098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:16.125748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-edf0e743-db2a-4b27-b8bc-0977d78bdc81 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.401865 Sep 19 15:10:16.128610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 39/84] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:15 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:16.200942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-59226bca-839e-4dc9-94a3-680817441564 req-cf50b279-6936-403c-8caa-f67b8567baa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94201d17-c5c8-44d8-b1ea-5cec58d30ede", "tag": "102d73ca-2eef-4409-9398-a9a28b924ce4"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:16.212179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-59226bca-839e-4dc9-94a3-680817441564 req-cf50b279-6936-403c-8caa-f67b8567baa5 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.212804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-59226bca-839e-4dc9-94a3-680817441564 req-cf50b279-6936-403c-8caa-f67b8567baa5 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.213551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-59226bca-839e-4dc9-94a3-680817441564 req-cf50b279-6936-403c-8caa-f67b8567baa5 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.229579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-59226bca-839e-4dc9-94a3-680817441564 req-cf50b279-6936-403c-8caa-f67b8567baa5 service nova] Creating event network-changed:102d73ca-2eef-4409-9398-a9a28b924ce4 for instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede on hv-cinder-75671 Sep 19 15:10:16.235038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-59226bca-839e-4dc9-94a3-680817441564 req-cf50b279-6936-403c-8caa-f67b8567baa5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038263 Sep 19 15:10:16.235643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 46/85] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:16.697812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:16.698985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:16.705780 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.706263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.706701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.707399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.707864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.708290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.747155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:16.747884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:16.757538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.758034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.758473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.759186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:16.759642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:16.760241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:16.981429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:16.992231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:16.993894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:16.995170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f066e5bc-a164-4bdc-a845-8fad6420a311 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.303238 Sep 19 15:10:16.995791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 40/86] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:16 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:17.020797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:17.029407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fcbf3207-fb65-41cc-b5af-0dfc56b18621 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.286699 Sep 19 15:10:17.029977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 47/87] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:16 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:17.108925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:17.109803 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:17.117621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:17.118142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:17.118532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:17.119230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:17.119684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:17.120106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:17.151583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:17.153268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:17.160021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:17.160524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:17.160984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:17.161678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:17.162133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:17.162562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:17.328468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:17.337583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e254d42-2a84-4bf2-98f0-55f7eef10526 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.232347 Sep 19 15:10:17.338172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 41/88] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:17.364555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:17.373512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-07bdb5f5-d64d-4ac5-89ad-dc107eeb45c1 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.227648 Sep 19 15:10:17.389181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 48/89] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:17 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:18.019289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:18.019898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:18.025964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.026483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.026922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.027616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.028071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.028520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.052910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:18.054117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:18.060652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.061142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.061585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.062274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.062717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.063134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.248523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.257899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.259501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.260656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-03acd466-69d9-4bef-9a45-3e085490af63 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.245332 Sep 19 15:10:18.261804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 42/90] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:18 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:18.271724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.279710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-44e719cc-480c-4293-8136-568679231eb1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.231076 Sep 19 15:10:18.280286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 49/91] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:18 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:18.360997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:18.361614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:18.368417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.368947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.369433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.370134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.370590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.371016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.396119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:18.396776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:18.403186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.407529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.407529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.407529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:18.407529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:18.407893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:18.559861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.573402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c7a51911-a3a8-4c31-aaa9-421a1ae1961f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.216162 Sep 19 15:10:18.584433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:18.588925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 43/92] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:18.592972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a873d08a-4c53-43c8-9eb4-1adda72b121f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.200687 Sep 19 15:10:18.594892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 50/93] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:18 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:19.286936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:19.287550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:19.294310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.294877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.295537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.296441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.297128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.297629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.307461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:19.309717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:19.321810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.323340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.324392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.325306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.326673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.327963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.512751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:19.523386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:19.527573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:19.527573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-024d1356-aeb6-485f-a634-5b08f938467c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.243823 Sep 19 15:10:19.527573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 44/94] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:19 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:19.531472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:19.539789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-07b9148f-505d-437a-a3fc-e0f2c2221e96 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.240486 Sep 19 15:10:19.548855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 51/95] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:19 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:19.599376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:19.600811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:19.607093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.607652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.608158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.608959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.609420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.609932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.615289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:19.617316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:19.626100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.626870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.627317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.628654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:19.628654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:19.628888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:19.849670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:19.854003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:19.858153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3e726675-6960-470c-ab5c-a1a289666479 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.263124 Sep 19 15:10:19.858728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 45/96] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:19.862103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-19f43320-a1f9-41cd-bc2a-036b4125c622 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.250850 Sep 19 15:10:19.862756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 52/97] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:19 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:20.552214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:20.552800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:20.558893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:20.559403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:20.559843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:20.560564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:20.561854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:20.562715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:20.565851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:20.566859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:20.574921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:20.575401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:20.575835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:20.576568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:20.577020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:20.577440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:20.706904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=4 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:20.927593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:20.937535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:20.940410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:20.941674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0fddf4c1-d195-4bcb-81e9-07fde4ca44f6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.393521 Sep 19 15:10:20.942431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 46/98] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:20 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:20.955757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:20.967972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-12ba12cd-91dc-448e-8325-d2325a7312fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.408127 Sep 19 15:10:20.968580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 53/99] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:20 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:20.973329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:20.974334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:20.976606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:20.980119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:20.994254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:20.997019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:20.997476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:20.998574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.000753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.002024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.002642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.012157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.012644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.013399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.014026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.014456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.316910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:21.322516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:21.328798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5b6596ef-6ba6-46d2-922d-b1cc7925a1ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.359128 Sep 19 15:10:21.329365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 54/100] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:20 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:21.334029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f277c0a7-0b05-4754-904b-c58fea8388da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.390173 Sep 19 15:10:21.334762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 47/101] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:21.971001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:21.971727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:21.979085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.979654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.980162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.980958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:21.981531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:21.981979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:21.994189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:21.995610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:22.001528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.002221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.002893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.003756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.004378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.004826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.207243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:22.211081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:22.214822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:22.216892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:22.218385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:22.219829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d45334d2-4786-4eff-8373-657bcb9aa8b5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.253204 Sep 19 15:10:22.219949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-20585fb7-b7bb-44c7-8f44-1e05e4cccbd3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.229622 Sep 19 15:10:22.220428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 48/102] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:21 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:22.220677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 55/103] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:21 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:22.357419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:22.358783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:22.364803 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:22.365975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:22.374105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.374851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.375522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.377721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.378399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.378602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.379012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.379291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.379731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.380419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:22.381953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:22.382416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:22.605539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:22.608577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:22.614441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-83856d16-645e-4429-9f0c-993ebd51e8c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.261406 Sep 19 15:10:22.615097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 56/104] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:22.620471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2be68a0d-5df3-4757-9852-77e767d9cf3c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.267475 Sep 19 15:10:22.621074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 49/105] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:22 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:23.249170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:23.250058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:23.250658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:23.251067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:23.263887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.265611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.266190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.266755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.267342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.267850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.268675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.269511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.270169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.270809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.271447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.283131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.539587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.544727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.549831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9cc61f12-c839-4d2e-ba57-55f6b279ab16 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.303867 Sep 19 15:10:23.551584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 57/106] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:23 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:23.567115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.571885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.573137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dd4b42b8-4a3f-4b95-9e0c-a11fc05a3994 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.332494 Sep 19 15:10:23.573705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 50/107] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:23 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:23.645940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:23.646613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:23.648882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:23.649501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:23.654453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.655131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.655724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.656617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.656820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.657215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.657485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.657641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.657760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.658433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:23.658890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:23.659314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:23.935117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.946763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1aaf1a02-6b0f-42fd-90f4-97c59896a327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.311883 Sep 19 15:10:23.947964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 58/108] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:23.965965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:23.974136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b516c987-c6b6-4880-be44-b6a50d765879 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.331326 Sep 19 15:10:23.975510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 51/109] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:23 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:24.579496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:24.580094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:24.586894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:24.587867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:24.589646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:24.590422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:24.590889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:24.591320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:24.600425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:24.601056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:24.607339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:24.607868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:24.608473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:24.609234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:24.609709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:24.610318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:24.614578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:24.836813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:24.847358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-602295ff-c171-46c4-9078-5be681710b20 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.271848 Sep 19 15:10:24.848377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 59/110] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:24 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:24.862331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:24.871035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:24.872493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:24.873685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4075d80f-7761-4126-b2df-8173d6fa2b0e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.277450 Sep 19 15:10:24.874219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 52/111] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:24 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:24.994394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:24.994394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:24.999806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:25.000416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:25.006496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.008215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.009064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.009389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.009801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.009882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.010449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.010537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.010840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.010965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.011285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.011637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.216350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:25.227697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6f533670-eb7e-4e08-87ad-f58eb1238ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.260593 Sep 19 15:10:25.228310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 60/112] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:25.238249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:25.247103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0f0d863b-5b30-451c-9ffb-fba2498eae09 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.250900 Sep 19 15:10:25.247927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 53/113] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:24 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:25.872175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:25.872811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:25.878902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.879387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.879816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.880736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.881299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.881912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.902550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:25.903172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:25.909229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.909775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.910208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:25.910904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:25.911362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:25.911784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.098452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.107632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f8c298f4-aedc-4964-9699-fb3d19d762bb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.239368 Sep 19 15:10:26.108304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 61/114] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:25 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:26.112943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.122402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.123994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.125041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2589ef3f-0e95-4caa-9ce3-e03eed54d389 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.227891 Sep 19 15:10:26.125642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 54/115] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:25 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:26.262814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:26.263693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:26.270620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.271199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:26.271340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.272269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.272449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:26.273680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.279108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.279671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.279901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.280455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.280627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.281186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:26.281649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:26.282078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:26.678497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.682346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:26.690221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-199b6581-9f15-44af-9d02-748eec110125 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.431260 Sep 19 15:10:26.691054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 62/116] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:26.713486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-12412a04-8bfb-480c-8ef2-b29e8b8119db tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.441601 Sep 19 15:10:26.713486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 55/117] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:26 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:27.130653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:27.131826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:27.139023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.139516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.139961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.140710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.141165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.141608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.150611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:27.151224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:27.164621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.164621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.164621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.164940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.165195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.165574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.360958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:27.373364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4711492c-4916-4624-8780-e05fe41f8b50 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.246520 Sep 19 15:10:27.374143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 63/118] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:27 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:27.400392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:27.419632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:27.421601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:27.423052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-13f9baa8-ee97-4306-87df-527e6f466fdf tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.277197 Sep 19 15:10:27.424085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 56/119] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:27 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:27.718461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:27.719160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:27.733093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.733093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.733093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.733093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.733649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.746331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:27.747033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:27.755474 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.756024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.756649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.757359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:27.757817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:27.758248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:27.762974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:28.039912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.048469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6c662b2a-7a17-40f6-8c63-b075d62f2aad tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.333651 Sep 19 15:10:28.049140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 64/120] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:28.053408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.062011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-528176d3-0790-40ea-b624-7a3a88f695ee tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.330778 Sep 19 15:10:28.063220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 57/121] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:27 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:28.399729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:28.400379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:28.409108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:28.409108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:28.409108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:28.409412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:28.409806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:28.410227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:28.455119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:28.455119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:28.460683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:28.462379 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:28.464714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:28.468740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:28.471842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:28.472507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:28.685512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.690981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.694278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a2daafb1-f62a-4443-a7de-9434465cded3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.300036 Sep 19 15:10:28.695139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 65/122] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:28 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:28.714837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.716314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:28.717487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-12197305-0ac4-4619-8e6c-6e89a4b751fd tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.271708 Sep 19 15:10:28.718201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 58/123] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:28 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:29.081325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:29.086486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:29.087006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:29.088002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:29.092698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.093189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.093627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.093726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.094118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.094329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.094561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.094844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.095257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.095355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.095716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.096144 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.312157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:29.321288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7d6160ea-4b0c-45a9-898b-75269474b860 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.243724 Sep 19 15:10:29.321869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 66/124] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:29.323883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:29.331776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b42ca0e8-2b91-457a-8063-c43a97ad064c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.248817 Sep 19 15:10:29.332425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 59/125] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:29 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:29.718614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:29.719408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:29.726915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.727395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.728028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.728948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.729348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.729772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.748938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:29.751046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:29.760117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.763782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.763782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.763782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:29.763782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:29.764119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:29.920458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:29.932993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5df3a42d-acd8-4896-8313-bd82beb661cc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.218999 Sep 19 15:10:29.944888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 67/126] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:29 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:29.964701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:29.966717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:29.968191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:29.969343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fea0bfc4-d7e2-47bc-9f82-11371f0e4b01 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.229940 Sep 19 15:10:29.969910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 60/127] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:29 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:30.345465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:30.346148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:30.356348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:30.357098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:30.357435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.357931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.358364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.359060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.359510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.359932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.363624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.364203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.364777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.365595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:30.366147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:30.366625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:30.590171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:30.595330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:30.598677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-06fa069c-782b-4d84-b98d-54a0905235f7 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.247263 Sep 19 15:10:30.599250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 61/128] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:30 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:30.610496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-98ebf97c-5cde-4737-9e02-262dacfa116e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.269698 Sep 19 15:10:30.611069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 68/129] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:30.982727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:30.984783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:31.000741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:31.000741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:31.002021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.002877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.003464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.004442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.005175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.007077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.013083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.013683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.015815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.017340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.017811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.018240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.236646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.240931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.245936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c41424f1-ab66-4387-9018-fa79e35e6dd6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.271820 Sep 19 15:10:31.246525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 62/130] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:30 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:31.256550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.258135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.259419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-30c390d4-4434-46a4-bd71-8223fe66b55b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.265304 Sep 19 15:10:31.259973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 69/131] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:30 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:31.623120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:31.623722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:31.633196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.634524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.634967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.635685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.636127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.636647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.639342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:31.651430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:31.651430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.651430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.651430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.651854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:31.651854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:31.651854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:31.849158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.858816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:31.871915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4590d385-b7aa-4ea7-89a7-d7193283bac3 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.252469 Sep 19 15:10:31.877261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bd959866-7a89-4ca7-824b-88977053792a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.242640 Sep 19 15:10:31.888040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 70/132] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:31.888855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 63/133] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:31 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:32.269168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:32.269780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:32.276600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.277094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.277533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.278256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.278714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.279136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.285620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:32.286305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:32.293503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.294175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.294804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.295692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.296226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.297263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.488304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:32.494370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:32.500393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-37d80177-1ce5-4e21-b178-0ec80efa340d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.235006 Sep 19 15:10:32.517127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 71/134] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:32 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:32.517548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:32.517548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:32.517548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-07b8531b-919f-4bcb-9d65-023fdf9e3e81 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.224232 Sep 19 15:10:32.517901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 64/135] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:32 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:32.896013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:32.897379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:32.903632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.903955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:32.904162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.904872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.905016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:32.905574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.906078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.906498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.913334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.916610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.916610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.916610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:32.916610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:32.916932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:32.925594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:33.181769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:33.191430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-088185ca-8eb4-4e99-8de9-d0bb31f4ac9e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.297474 Sep 19 15:10:33.209322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 72/136] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:32 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:33.220825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:33.230668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-19c3d000-d706-48f8-9e32-fd01ba3e3d27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.332214 Sep 19 15:10:33.231641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 65/137] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:33.341967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-784a1b14-3bad-469f-b72b-c15f05a6acf6 req-71764d5d-0add-412f-93c7-eb3ee8cbc447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1889b4f-b5a8-45d3-ad20-cbb9566c46a8", "name": "network-vif-plugged", "status": "completed", "tag": "eaac7458-d66b-4bba-87e3-a6776b60728b"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:33.353063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-784a1b14-3bad-469f-b72b-c15f05a6acf6 req-71764d5d-0add-412f-93c7-eb3ee8cbc447 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.353578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-784a1b14-3bad-469f-b72b-c15f05a6acf6 req-71764d5d-0add-412f-93c7-eb3ee8cbc447 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.357034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-784a1b14-3bad-469f-b72b-c15f05a6acf6 req-71764d5d-0add-412f-93c7-eb3ee8cbc447 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:33.369553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-784a1b14-3bad-469f-b72b-c15f05a6acf6 req-71764d5d-0add-412f-93c7-eb3ee8cbc447 service nova] Creating event network-vif-plugged:eaac7458-d66b-4bba-87e3-a6776b60728b for instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 on hv-cinder-75671 Sep 19 15:10:33.375046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-784a1b14-3bad-469f-b72b-c15f05a6acf6 req-71764d5d-0add-412f-93c7-eb3ee8cbc447 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104762 Sep 19 15:10:33.375659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 73/138] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:33.530994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:33.531847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:33.531950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:33.532792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:33.539659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.540061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.540201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.540587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.540742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:33.541477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.542087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.542503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:33.542662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:33.543443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:33.543978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:33.544502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:33.742251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:33.751299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:33.759388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-233982bc-56fd-40fe-826a-df488717f9cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.234395 Sep 19 15:10:33.760132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 66/139] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:33 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:33.760647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:33.762241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:33.763580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9834297d-96a1-48a8-a42f-9804c399037a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.236032 Sep 19 15:10:33.775085 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 74/140] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:33 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:34.221759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:34.222406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:34.238007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.238506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.243393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.244378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.244973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.245409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.255525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:34.257189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:34.266687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.267773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.268403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.269477 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.270004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.270879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.449575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:34.457864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7022d912-7721-41a5-8cef-7740fcb69bad tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.239892 Sep 19 15:10:34.458880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 67/141] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:34 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:34.463779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:34.480981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fc88bd63-1870-4b11-9664-3b7c907b5870 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.230061 Sep 19 15:10:34.481568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 75/142] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:34.787093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:34.788783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:34.792142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:34.792759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:34.795123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.795624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.796068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.796859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.797255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.801873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.805161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.805161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.805161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.805161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:34.805570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:34.805971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:34.998219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.001738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:35.005082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.006325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-df9c29c5-9f48-4403-ad25-1d80f08199ba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.223212 Sep 19 15:10:35.007010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 68/143] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:34 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:35.014095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.015619 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.016977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e751b7e2-59b9-40ae-8476-6fa5d422f9f4 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.228624 Sep 19 15:10:35.017527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 76/144] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:34 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:35.481703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:35.482345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:35.488627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.489112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.489552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.490934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.491561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.492000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.504320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:35.505010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:35.511060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.511574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.512029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.512747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:35.513195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:35.513654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:35.697144 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.697632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:35.705276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-81ddacad-8e50-4ccf-84a3-978fe2ee297e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.204766 Sep 19 15:10:35.705413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-68510745-8dbe-46e4-a403-32c042cf3f41 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.228020 Sep 19 15:10:35.705882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 77/145] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:35.706030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 69/146] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:35 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:36.032285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:36.032911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:36.039485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.039969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.040407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.041159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.041615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.042037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.042260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:36.042861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:36.048919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.049395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.049821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.050499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.050944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.051361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.238047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:36.243284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:36.246683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2a8a80b-8a78-4624-95c9-0ba5ccba8131 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.218311 Sep 19 15:10:36.247260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 70/147] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:36 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:36.252018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:36.253482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:36.254575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5bf8de07-3231-4831-ab46-763fb7633a0d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.216125 Sep 19 15:10:36.255114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 78/148] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:36 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:36.729601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:36.730388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:36.734458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:36.735062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:36.736828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.737312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.737745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.738431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.739044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.739464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.741601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.746789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.746789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.746789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:36.746789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:36.747128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:36.946329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:36.949709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:36.954134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-83f70405-1718-4dc4-9ea4-a2da68a0aab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.228547 Sep 19 15:10:36.954712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 71/149] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:36.957178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0825add1-3a53-4f63-a5ca-2bbcafc8cb57 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.226613 Sep 19 15:10:36.957722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 79/150] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:36 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:37.269900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:37.270464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:37.277076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.277623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.278066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.278761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.278947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:37.279213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.279513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:37.279617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.285437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.285922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.286359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.287201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.287931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.288504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.476397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:37.480076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:37.484091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-becba89f-a868-4b76-ba76-c60cab62bcc7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.218082 Sep 19 15:10:37.484677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 72/151] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:37 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:37.488048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:37.489523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:37.494813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4898657b-953b-4321-96a1-dde6a0c3f68b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.215667 Sep 19 15:10:37.494813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 80/152] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:37 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:37.977885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:37.978552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:37.980916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:37.981543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:37.983852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=99 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:37.984890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.985309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.985748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.986470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.986919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.987346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.992376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.993177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.994004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:37.994712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:37.995161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:37.999265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:38.183987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:38.187150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:38.191730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33229db2-f19b-42b7-9e00-e96e2698c27d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.218289 Sep 19 15:10:38.192387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 73/153] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:38.194951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2fb2f44a-8566-4ee0-9c45-23a4f17bd29b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.217780 Sep 19 15:10:38.195505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 81/154] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:37 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:38.507519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:38.508076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:38.514063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:38.514546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:38.514984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:38.515675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:38.516135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:38.516589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:38.518112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:38.518717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:38.525449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:38.525936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:38.526368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:38.528718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:38.528718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:38.528718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:38.720990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:38.724448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:38.729277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ba02c5d3-4042-4b6f-a8dc-48680b914db1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.225633 Sep 19 15:10:38.729937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 74/155] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:38 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:38.732955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:38.734407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:38.735510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-28f06330-31a3-4e50-9f8c-e7fd0dd52ec6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.221286 Sep 19 15:10:38.736068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 82/156] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:38 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:39.215356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:39.215998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:39.216621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:39.217224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:39.222011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.222490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.223181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.223299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.223695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.223863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.224128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.224317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.224856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.224967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.225372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.225788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.614833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:39.618020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:39.623142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c1522d07-d4fc-47af-bab4-ad54a87deaf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.411629 Sep 19 15:10:39.623760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 75/157] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:39.626232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f913383e-6ef4-4758-8028-a6d5e86277b5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.413499 Sep 19 15:10:39.626791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 83/158] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:39 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:39.752383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:39.752942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:39.759307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.759792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.760228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.760952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.761108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:39.761408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.761717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:39.761823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.767652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.768128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.768585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.769272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:39.769724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:39.770151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:39.961669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:39.967894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-96e2161b-216a-4aa6-9890-0b01cc2b0c65 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.219361 Sep 19 15:10:39.968323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:39.969958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 76/159] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:39 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:39.977741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:39.979178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:39.980257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7c2d84d0-fee4-440a-8b5b-fe8709dfd928 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.223062 Sep 19 15:10:39.980835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 84/160] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:39 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:40.647946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:40.648457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:40.650054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:40.650739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:40.654397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:40.654870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:40.655303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:40.655982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:40.656428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:40.656794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:40.656895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:40.657279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:40.657711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:40.658618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:40.659077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:40.659498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:40.852236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:40.855674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:40.860106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c762f849-c001-478a-a702-470df912abb3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.216729 Sep 19 15:10:40.860722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 77/161] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:40.863306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4d4cefb7-cde6-406e-9c2c-12ee0f129c5c tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.217768 Sep 19 15:10:40.863863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 85/162] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:40 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:40.995558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:40.996165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:41.002596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.003125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.003518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.008206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.008206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.008206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.008446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:41.008446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:41.014270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.014754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.015189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.015884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.016367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.016830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.214007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:41.220974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:41.221698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8ea8dd0e-8b9f-4e3e-ad16-c54134434a63 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.230797 Sep 19 15:10:41.222269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 78/163] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:40 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:41.230034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:41.231463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:41.232588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ab268df8-59e3-46cc-99f0-aff962d84d0b tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.230353 Sep 19 15:10:41.233176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 86/164] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:41 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:41.885375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:41.886069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:41.886805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:41.887425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:41.892038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.892543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.892974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.893284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.893653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.893750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.894102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.894195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.894525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:41.894855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:41.895319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:41.895743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:42.088340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:42.091351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:42.095946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d6548c80-936d-44f6-a0f6-527024ac0131 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.214842 Sep 19 15:10:42.096544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 79/165] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:42.099154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-24167797-2b05-45e2-967c-5d9a11647901 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.216142 Sep 19 15:10:42.100294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 87/166] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:41 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:42.246259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:42.247097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:42.253155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:42.253640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:42.254073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:42.254755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:42.255206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:42.256128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:42.259419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:42.260075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:42.265954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:42.266433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:42.266888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:42.267604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:42.268052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:42.268470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:42.447798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:42.455542 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6d2c95f5-a25c-4cd5-9f9c-61def02cedf8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.213590 Sep 19 15:10:42.456217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 80/167] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:42 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:42.465455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:42.474145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:42.476408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:42.477611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8b377389-233f-4630-944d-4a8ec37e11fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.222852 Sep 19 15:10:42.478162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 88/168] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:42 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:43.120384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:43.121103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:43.122126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:43.122741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:43.127188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.127710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.128146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.128557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.128864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.129043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.129323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.129479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.129749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.130164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.131328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.131719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.323741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:43.332551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-16996852-2e47-41e3-936f-d884592d8121 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.215992 Sep 19 15:10:43.333741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 81/169] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:43.337078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:43.342649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:43.345314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3c08ed22-ab1e-47ba-81dc-2605d9f44f17 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.226976 Sep 19 15:10:43.345970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 89/170] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:43 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:43.480122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:43.480690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:43.486723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.487205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.487644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.488342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.488831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.489256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.502085 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:43.502660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:43.508874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.509364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.509799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.510495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:43.510951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:43.511375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:43.686985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:43.694854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6cc586a6-6d1e-4ffd-a451-d4843fcab07d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.218628 Sep 19 15:10:43.695621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 82/171] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:43 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:43.701468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:43.710064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:43.711510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:43.712643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ef2c8b46-92f8-435d-b1cd-42bad5dde492 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.214820 Sep 19 15:10:43.713205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 90/172] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:43 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:44.355485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:44.356087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:44.362241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.362800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.363339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.364038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.364519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.365025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.368663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:44.369285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:44.375574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.376060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.376517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.377216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.377725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.378152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.562387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:44.570685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-061ae3ec-bf05-47fa-9441-469a81197327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.219180 Sep 19 15:10:44.571260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 83/173] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:44.574202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:44.581887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-654a49ca-e114-4df1-8782-c35bb3e2f985 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.217361 Sep 19 15:10:44.582439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 91/174] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:44 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:44.717830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:44.718439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:44.724657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.725135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.725564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.726244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.726695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.727116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.736987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:44.737518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:44.744053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.744559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.744990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.745674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:44.746121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:44.746542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:44.929737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:44.933346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:44.937537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e88da8d-6046-4926-885d-4903813f4ee2 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.223591 Sep 19 15:10:44.938309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 84/175] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:44 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:44.941799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:44.943467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:44.944638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9965d7ee-3473-4d9e-a380-dbc20cc016ab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.211460 Sep 19 15:10:44.945198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 92/176] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:44 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:45.593222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:45.593818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:45.600817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.601359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.601995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.602692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.603146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.603566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.605819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:45.607213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:45.613082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.613593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.614027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.614714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.615854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.616278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.622577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:45.799932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:45.807529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:45.808506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-34efa157-f6a9-4a41-a3cd-000c5821c449 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.219039 Sep 19 15:10:45.809076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 85/177] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:45.815825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f9bded65-0de2-4fe3-84e5-e4c9f7b8aba5 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.213832 Sep 19 15:10:45.816522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 93/178] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:45 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:45.960668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:45.961283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:45.967526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.968004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.968434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.969294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:45.970057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:45.970171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.970619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.971056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.977007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.977482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.977920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:45.978621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:45.979077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:45.979700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:46.168833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:46.171953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:46.176572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c1ace769-ff23-408b-88c0-62bbf1d32718 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.219991 Sep 19 15:10:46.177158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 86/179] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:45 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:46.180470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:46.181943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:46.183047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62304c79-dc6b-4554-afbb-feb468e17db8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.217566 Sep 19 15:10:46.183606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 94/180] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:45 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:46.606267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-c6443c19-8bda-489f-a686-4f760fb12e40 req-5c11dcda-c5e9-472e-8287-d6b65f385ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a37d13a-b506-47f9-9473-9263fa583258", "name": "network-vif-plugged", "status": "completed", "tag": "09b225b1-fd59-4d43-934b-bf41d463c818"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:46.615898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c6443c19-8bda-489f-a686-4f760fb12e40 req-5c11dcda-c5e9-472e-8287-d6b65f385ae0 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:46.616376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c6443c19-8bda-489f-a686-4f760fb12e40 req-5c11dcda-c5e9-472e-8287-d6b65f385ae0 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:46.616831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c6443c19-8bda-489f-a686-4f760fb12e40 req-5c11dcda-c5e9-472e-8287-d6b65f385ae0 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:46.627991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-c6443c19-8bda-489f-a686-4f760fb12e40 req-5c11dcda-c5e9-472e-8287-d6b65f385ae0 service nova] Creating event network-vif-plugged:09b225b1-fd59-4d43-934b-bf41d463c818 for instance 0a37d13a-b506-47f9-9473-9263fa583258 on hv-cinder-75671 Sep 19 15:10:46.643234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-c6443c19-8bda-489f-a686-4f760fb12e40 req-5c11dcda-c5e9-472e-8287-d6b65f385ae0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031517 Sep 19 15:10:46.643234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 87/181] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:46.831752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:46.832576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:46.839228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:46.839718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:46.840151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:46.840875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:46.841330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:46.841750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:46.843585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:46.844296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:46.846238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:46.852064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:46.852581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:46.856382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:46.856382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:46.856382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:46.856382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.054456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:47.062920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7cf3fa30-f5c8-4b70-b37c-454b04a1b861 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.235620 Sep 19 15:10:47.063193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:47.063494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 95/182] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:47.072199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8f9cb74a-d3e9-4b32-b9a3-27855ceff19b tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.232758 Sep 19 15:10:47.072955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 88/183] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:46 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:47.199578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:47.200219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:47.206296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:47.210825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:47.210944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:47.211044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.211133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:47.211235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:47.211235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:47.211235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.214636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:47.215117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:47.215562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.216321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:47.216879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:47.217302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:47.407134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:47.419836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ccd5b51-ebac-492b-a5d4-261a0e14181c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.223926 Sep 19 15:10:47.421170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 96/184] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:47 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:47.423463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:47.432633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:47.434384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:47.437746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-af59c075-cee5-41b0-b861-7e6cc56dd910 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.234613 Sep 19 15:10:47.438770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 89/185] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:47 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:48.086464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:48.087110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:48.093699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.094190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.094662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.095218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:48.095645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.095797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.095896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:48.096213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.102466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.103250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.104952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.104952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.105776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.106797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.300898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.310083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c0e13a7b-b776-4deb-829e-f17f0d0822a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.228439 Sep 19 15:10:48.310664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 97/186] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:48.328546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.340870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4bdee12e-b1bc-4d9e-81d6-ef2518b8963a tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.249423 Sep 19 15:10:48.341457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 90/187] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:48 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:48.443635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:48.444632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:48.454232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.459094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.459094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.459094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.459094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.459463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.466495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:48.467644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:48.475380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.481609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.481609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.481609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:48.481609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:48.481997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:48.711921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.718518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.719827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-93580c16-1866-4585-8f02-9792a18f61f3 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.280411 Sep 19 15:10:48.721638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 98/188] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:48 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:48.732259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.733880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:48.735432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d64226bc-9c13-4063-a930-99e61064bf78 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.274966 Sep 19 15:10:48.738147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 91/189] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:48 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:49.334587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:49.338588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:49.341244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.341724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.342153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.342838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.343300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.343865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.370562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:49.371924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:49.377436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.377983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.378402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.379093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.379545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.380038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.537291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.547191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f331a439-5748-41f3-8efb-b217947a9ea9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.216542 Sep 19 15:10:49.555123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 99/190] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:49.563719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.573259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-65e0032c-2fc0-4647-9601-86f841ed0e32 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.207215 Sep 19 15:10:49.573852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 92/191] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:49 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:49.747902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:49.748228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:49.756987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.756987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.756987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.757445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.757937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.758389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.762568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:49.763185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:49.769618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.770102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.770541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.776340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:49.776340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:49.779392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:49.958960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.966181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f6117db2-32a2-44bb-aabc-4fbb47c697cf tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.222683 Sep 19 15:10:49.966758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 100/192] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:49 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:49.981130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.989159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.990586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:49.991669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b10af1a7-0c14-41b9-8689-9b0a926917e9 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.233016 Sep 19 15:10:49.992213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 93/193] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:49 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:50.571074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:50.571687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:50.577740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.578221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.578655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.579342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.579799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.580223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.596930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:50.597527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:50.604633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.605124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.605554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.606240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.606689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.607110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.778316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:50.787272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6cc1ee3d-7c42-4158-a1e7-16fd452cf3b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.220248 Sep 19 15:10:50.787848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 101/194] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:50.797135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:50.806772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-88d308cd-abf7-4589-b1b5-89f807ef226f tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.213548 Sep 19 15:10:50.807522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 94/195] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:50 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:50.990656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:50.991299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:50.997559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.998047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:50.998499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:50.999255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:50.999643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.000071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:51.015518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:51.016199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:51.022095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:51.022691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.023968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:51.024691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:51.025141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.025564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:51.215528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:51.218160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:51.224184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7185aa66-e589-4551-bd94-1719077e3f00 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.237311 Sep 19 15:10:51.225029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 102/196] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:50 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:51.233136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:51.234616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:51.235916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-055b37c9-5fb0-4842-95b7-4f1f7cac0517 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.224260 Sep 19 15:10:51.236655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 95/197] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:51 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:51.810256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:51.810989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:51.817057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:51.817627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.818146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:51.818844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:51.819300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.820370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:51.832468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:51.834588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:51.842904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:51.843575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.844299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:51.845254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:51.846075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:51.847055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.205004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.213844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-734e7a3e-3c62-4470-98a0-815fbeaef488 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.407464 Sep 19 15:10:52.214408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 103/198] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:52.228435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.238912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6f85ac48-269e-4712-89e1-8df5ead5f169 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.410674 Sep 19 15:10:52.239539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 96/199] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:51 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:52.248380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:52.249061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:52.255436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:52.255921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:52.258732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.258732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:52.258732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:52.259312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.266963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:52.267566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:52.283107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:52.283107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:52.283539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.284296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:52.284837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:52.285312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:52.474355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.479308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.490971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c557b9c5-91f2-49fb-b814-5af4ce9132ae tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.240698 Sep 19 15:10:52.490971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 104/200] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:52 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:52.491205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.491205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:52.493654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3a5fd95-6e06-4f07-93ee-3f314374d20c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.230259 Sep 19 15:10:52.494289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 97/201] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:52 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:53.238847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:53.239678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:53.247955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.247955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.247955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.247955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.248546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.248858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.267651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:53.268258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:53.275085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.275773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.275990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.276706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.277258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.277680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.422695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.431519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-89bcb8fe-ccef-4ddf-9e94-0b20d38d091d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.196617 Sep 19 15:10:53.432289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 105/202] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:53.469089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.478984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e95440f-4aba-48ea-a959-33e3eef7e794 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.215295 Sep 19 15:10:53.479505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 98/203] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:53 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:53.508699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:53.509304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:53.515586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.516054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.516502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.517244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.517635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.518052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.520512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:53.522088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:53.529101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.529532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.529967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.530788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:53.531249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:53.531676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:53.539797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:53.725562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.729767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.733666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cd6a4719-3e62-4574-b1e0-62eca4a07021 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.228942 Sep 19 15:10:53.734245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 106/204] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:53 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:53.738124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.739559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:53.740682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0e74d304-7d1d-48ef-b19f-71678faf200d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.224995 Sep 19 15:10:53.741750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 99/205] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:53 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:54.455399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:54.456003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:54.462851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.463330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.463757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.464446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.464936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.465352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.508626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:54.509259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:54.515547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.523943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.523943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.523943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.523943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.524284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.676366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:54.685103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-be10e4a4-2fa3-44d1-b43b-b12939a614e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.233463 Sep 19 15:10:54.685686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 107/206] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:54.699929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:54.709301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8b2d238c-5e95-4a2a-8e4d-bbbc9dcf7def tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.210349 Sep 19 15:10:54.709871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 100/207] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:54 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:54.757032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:54.757658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:54.763733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.764287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.764822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.765578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.766132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.766621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.770901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:54.771848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:54.778308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.779424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.780651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.781368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:54.781868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:54.782302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:54.982501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:54.986414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:55.003940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fca8b11d-ce7b-465c-9fba-cb303c4cfcdd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.238563 Sep 19 15:10:55.003940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 108/208] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:54 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:55.004149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:55.004149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:55.004149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-43d4cb98-5b81-4414-96e2-e48153adcbc2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.231527 Sep 19 15:10:55.004432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 101/209] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:54 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:55.708912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:55.709548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:55.717125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:55.717615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:55.718052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:55.718749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:55.719206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:55.719630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:55.732750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:55.733934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:55.740001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:55.740500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:55.740952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:55.742168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:55.742675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:55.743096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:55.938090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:55.947484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-775d3e77-ccff-4c34-8521-28dd75c5a9ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.242553 Sep 19 15:10:55.948114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 109/210] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:55.966082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:55.969761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:10:55.975147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3dab091a-026d-4784-ab9d-8cb08f64cffd tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.246615 Sep 19 15:10:55.976563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 102/211] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:55 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:56.014351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:56.015068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:56.021680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.025584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.025584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.025584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.025584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.026081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.027256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:56.028022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:56.035935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.036414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.036875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.037573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.038027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.039105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.254645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:56.258385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a15e05eb-47bd-4202-b1e8-927bc838ea5e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.247810 Sep 19 15:10:56.260603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:56.268804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:56.270471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:56.271767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-668c7601-da78-48bd-9852-f2b4067d8fec tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.250739 Sep 19 15:10:56.284506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 110/212] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:56 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:56.285369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 103/213] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:56 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:56.290723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-fe3ab9b5-bd75-4b31-946d-28e81b6bf8ea req-0698e242-db93-4290-a4de-3e1e5569e8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751262b-7323-4c6a-b3f1-830fb2448558", "name": "network-vif-plugged", "status": "completed", "tag": "f872e19c-541e-4edf-b7d4-a8a9c1d84150"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:10:56.301842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-fe3ab9b5-bd75-4b31-946d-28e81b6bf8ea req-0698e242-db93-4290-a4de-3e1e5569e8fc service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.302374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-fe3ab9b5-bd75-4b31-946d-28e81b6bf8ea req-0698e242-db93-4290-a4de-3e1e5569e8fc service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.302809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-fe3ab9b5-bd75-4b31-946d-28e81b6bf8ea req-0698e242-db93-4290-a4de-3e1e5569e8fc service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.315161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-fe3ab9b5-bd75-4b31-946d-28e81b6bf8ea req-0698e242-db93-4290-a4de-3e1e5569e8fc service nova] Creating event network-vif-plugged:f872e19c-541e-4edf-b7d4-a8a9c1d84150 for instance 2751262b-7323-4c6a-b3f1-830fb2448558 on hv-cinder-75671 Sep 19 15:10:56.323836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-fe3ab9b5-bd75-4b31-946d-28e81b6bf8ea req-0698e242-db93-4290-a4de-3e1e5569e8fc service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048735 Sep 19 15:10:56.324877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 111/214] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:10:56.971048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:56.971653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:56.980639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.981195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.981760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:56.982698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:56.983369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:56.983999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.002157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:57.002854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:57.009448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.009924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.010416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.011288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.011800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.012225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.222876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.230953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ff79aad1-4d3d-4908-8e4f-de94d2428819 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.263720 Sep 19 15:10:57.231568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 104/215] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:57.234812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.243126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d5da53d8-ff2f-483b-9210-2e84e8b461a8 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.245248 Sep 19 15:10:57.243677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 112/216] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:56 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:57.283062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:57.283698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:57.290081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.290588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.291027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.291728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.292228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.292686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.298693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:57.299487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:57.307060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.313871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.313871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.313871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:57.313871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:57.314222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:57.503042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.508667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.512175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b8b8386b-05ec-42ed-87a0-63f76dc85227 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.232877 Sep 19 15:10:57.512844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 105/217] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:57 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:57.519153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.521071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:57.522148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-76e3a010-96ea-40a8-995c-ced6a9f4f1fc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.227563 Sep 19 15:10:57.531681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 113/218] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:57 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:10:58.256858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:58.256858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:58.261677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.262175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.262609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.263309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.263768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.264239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.266386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:58.267200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:58.273441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.273921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.274350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.275136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.275751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.276327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.499782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.513954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7c7856b0-c971-4d6d-8a7d-d3ca056124a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.258353 Sep 19 15:10:58.513954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 106/219] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:58.514102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.525892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fad4e760-5324-4162-9c21-bce7194e8b55 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.263180 Sep 19 15:10:58.526546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 114/220] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:58 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:58.535595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:58.536568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:58.551357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.551357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.551357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.551357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.551686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.551686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.551848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:58.551848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:58.558887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.559462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.559962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.560752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:58.561266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:58.561958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:58.768362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.779063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d745e826-7208-458f-af61-4b988e5faba4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.247221 Sep 19 15:10:58.800512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 107/221] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:58 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:10:58.801248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.810169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.811608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:58.812737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-acac8a8d-f999-4c2d-b478-1db9f0014b05 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.268003 Sep 19 15:10:58.813282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 115/222] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:58 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:10:59.533858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:59.534468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:59.540614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.541118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.541546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.542232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.542680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.543200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.552073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:59.553286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:59.560362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.561025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.561699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.562941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.563576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.565937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.758492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:59.762658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:10:59.766308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3e13e8dc-6c55-4120-a7c1-f2a345c64ec5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.236277 Sep 19 15:10:59.766900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 108/223] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:59.777047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8b1d2d4a-35ae-473e-880d-f7904d401a12 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.229403 Sep 19 15:10:59.780311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 116/224] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:59 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:10:59.810428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:59.811029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:59.819108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.819108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.819108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.819108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.819872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.819872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.851323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:10:59.851323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:10:59.857309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.857831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.858280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:10:59.859235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:10:59.859729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:10:59.860154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:00.009533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:00.017460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d1d5dca7-0369-4413-8857-6ee8a24336cd tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1364 microversion: 2.1 time: 0.210807 Sep 19 15:11:00.018023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 109/225] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:10:59 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:00.032373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:00.041384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:00.042830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:00.043938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b15050f-7b75-4954-8d90-1fd97fc85d64 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.201241 Sep 19 15:11:00.044518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 117/226] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:10:59 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:11:00.446360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-2d9d4edc-e536-4f66-84e6-b6907af82f3c req-8f8cdaff-d209-4c4e-a187-76bb21326182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94201d17-c5c8-44d8-b1ea-5cec58d30ede", "name": "network-vif-plugged", "status": "completed", "tag": "102d73ca-2eef-4409-9398-a9a28b924ce4"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:00.457594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-2d9d4edc-e536-4f66-84e6-b6907af82f3c req-8f8cdaff-d209-4c4e-a187-76bb21326182 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:00.458073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-2d9d4edc-e536-4f66-84e6-b6907af82f3c req-8f8cdaff-d209-4c4e-a187-76bb21326182 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:00.458495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-2d9d4edc-e536-4f66-84e6-b6907af82f3c req-8f8cdaff-d209-4c4e-a187-76bb21326182 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:00.470612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-2d9d4edc-e536-4f66-84e6-b6907af82f3c req-8f8cdaff-d209-4c4e-a187-76bb21326182 service nova] Creating event network-vif-plugged:102d73ca-2eef-4409-9398-a9a28b924ce4 for instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede on hv-cinder-75671 Sep 19 15:11:00.476563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-2d9d4edc-e536-4f66-84e6-b6907af82f3c req-8f8cdaff-d209-4c4e-a187-76bb21326182 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Sep 19 15:11:00.477159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 110/227] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:00.789281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:00.789894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:00.795890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:00.796376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:00.796845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:00.797534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:00.797998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:00.798423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:00.810534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:00.813355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:00.817276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:00.817827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:00.818185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:00.818899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:00.819350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:00.820284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.052979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.062376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-047ac953-3f23-4111-bc34-e28e3efc04b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1367 microversion: 2.1 time: 0.277032 Sep 19 15:11:01.062940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 118/228] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:01.067614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:01.068209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:01.075820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:01.076441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:01.077014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.077213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.078033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:01.078589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:01.079238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.084834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5de98547-d611-452c-9fb2-d0a6baf7e4e6 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1315 microversion: 2.1 time: 0.278417 Sep 19 15:11:01.086061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 111/229] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:00 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:11:01.090429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:01.091261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:01.097219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:01.097737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:01.098422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.099128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:01.099557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:01.099971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.286297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.294158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e9014698-94dc-48f2-a52b-c51b33d1a67a tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 200 len: 1550 microversion: 2.1 time: 0.230000 Sep 19 15:11:01.294711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 119/230] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:01 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 1550 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:01.300756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.309334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.311001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:01.312087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-32d2536f-2889-4950-ac98-5ae7dd165de5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.225250 Sep 19 15:11:01.312712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 112/231] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:11:01 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:11:01.317639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:01.318209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:01.325348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:01.325927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:01.326440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.327144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:01.327601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:01.328027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:01.444439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-13014de9-fc8e-4533-8257-8e6f56499495 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130477 Sep 19 15:11:01.445117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 120/232] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:11:01 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:02.086671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:02.087748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:02.094504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.095238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.095818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.096737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.097338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.098126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.111805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:02.112669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:02.120108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.122742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.123538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.126093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.127604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.130389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.547912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:02.552703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:02.557167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ac668df4-cc96-43ef-ad92-9770c5c3b9b9 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1501 microversion: 2.1 time: 0.450622 Sep 19 15:11:02.557753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 121/233] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:02 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1501 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:11:02.562563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:02.563173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:02.563328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7bfbb23b-0e68-402c-96cb-906b800a6d80 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1557 microversion: 2.1 time: 0.481110 Sep 19 15:11:02.564351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 113/234] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1557 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:02.569167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.569715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.570210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.571049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.571529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.571963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.606713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:02.607279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:02.616375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.617195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.617992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.618908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:02.619574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:02.620259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:02.883532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f7f5b6be-ec29-4834-a44c-fa787abcd756 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295044 Sep 19 15:11:02.884631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 114/235] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:11:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:02.975302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:02.985163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:02.986869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:02.988163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7ef8b54f-11f3-4209-bbcd-7c1d6f3255d0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.429326 Sep 19 15:11:02.988936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 122/236] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:11:02 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:11:03.253920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-97de380d-8f93-4bb1-8894-c0f36fce1714 req-6849e37d-cc6b-451c-9269-d75b09afe91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a37d13a-b506-47f9-9473-9263fa583258", "tag": "09b225b1-fd59-4d43-934b-bf41d463c818"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:03.265695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-97de380d-8f93-4bb1-8894-c0f36fce1714 req-6849e37d-cc6b-451c-9269-d75b09afe91c service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:03.266341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-97de380d-8f93-4bb1-8894-c0f36fce1714 req-6849e37d-cc6b-451c-9269-d75b09afe91c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:03.266852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-97de380d-8f93-4bb1-8894-c0f36fce1714 req-6849e37d-cc6b-451c-9269-d75b09afe91c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:03.280314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-97de380d-8f93-4bb1-8894-c0f36fce1714 req-6849e37d-cc6b-451c-9269-d75b09afe91c service nova] Creating event network-changed:09b225b1-fd59-4d43-934b-bf41d463c818 for instance 0a37d13a-b506-47f9-9473-9263fa583258 on hv-cinder-75671 Sep 19 15:11:03.286293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-97de380d-8f93-4bb1-8894-c0f36fce1714 req-6849e37d-cc6b-451c-9269-d75b09afe91c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036600 Sep 19 15:11:03.286966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 115/237] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:04.014856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:04.016128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:04.024821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:04.025836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:04.026489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:04.030303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:04.030303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:04.030303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:04.323443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:04.332418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:04.335533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:04.335533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-927fcb2c-6e11-4d1a-9a90-52cc788b4c16 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.324746 Sep 19 15:11:04.336127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 123/238] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:11:04 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:11:04.897848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-dadd2c74-66fe-4c9d-9ef2-66ccfd8221ed req-499f7537-3182-4c33-b03d-65103b00c250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2751262b-7323-4c6a-b3f1-830fb2448558", "tag": "f872e19c-541e-4edf-b7d4-a8a9c1d84150"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:04.912100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-dadd2c74-66fe-4c9d-9ef2-66ccfd8221ed req-499f7537-3182-4c33-b03d-65103b00c250 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:04.913933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-dadd2c74-66fe-4c9d-9ef2-66ccfd8221ed req-499f7537-3182-4c33-b03d-65103b00c250 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:04.914514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-dadd2c74-66fe-4c9d-9ef2-66ccfd8221ed req-499f7537-3182-4c33-b03d-65103b00c250 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:04.931871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-dadd2c74-66fe-4c9d-9ef2-66ccfd8221ed req-499f7537-3182-4c33-b03d-65103b00c250 service nova] Creating event network-changed:f872e19c-541e-4edf-b7d4-a8a9c1d84150 for instance 2751262b-7323-4c6a-b3f1-830fb2448558 on hv-cinder-75671 Sep 19 15:11:04.938606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-dadd2c74-66fe-4c9d-9ef2-66ccfd8221ed req-499f7537-3182-4c33-b03d-65103b00c250 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045281 Sep 19 15:11:04.939691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 116/239] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:05.370056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:05.370056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:05.371868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:05.372618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:05.373119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:05.374222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:05.374860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:05.375840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:05.381456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:05.547029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:05.557800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:05.560321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:05.561778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7c16ed4a-96fe-4f4e-82a2-97e396498347 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1407 microversion: 2.20 time: 0.204277 Sep 19 15:11:05.562524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 124/240] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:11:05 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:11:05.854387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "498d1579-de68-4927-965d-d85edfef6f5f"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:05.856832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:05.863371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:05.864060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:05.864787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:05.865641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:05.866247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:05.867357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:06.590637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:06.591247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:06.597629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:06.598110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:06.598806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:06.599490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:06.599939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:06.600359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:06.741581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:06.750195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:06.751635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:06.752824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bbfc13bd-2278-499d-829e-b520ee866639 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 200 len: 1597 microversion: 2.20 time: 0.166326 Sep 19 15:11:06.764798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 125/241] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:11:06 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:11:06.801795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:06.802288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:06.809119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:06.809607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:06.810104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:06.811047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:06.811500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:06.812119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:06.920780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9d0eeabc-71b4-45fc-a376-7c01d21915e0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122761 Sep 19 15:11:06.921452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 126/242] 10.222.0.75 () {60 vars in 1316 bytes} [Mon Sep 19 15:11:06 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:11:07.757790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0c2976ba-5e74-42d9-8c71-47f792bbbbbb tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "POST /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.909012 Sep 19 15:11:07.758437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 117/243] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:11:05 2022] POST /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8/os-volume_attachments => generated 194 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:08.428403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-54683caa-3fb8-4be5-a4ee-4dc0621fd544 req-e673d34f-f969-4327-8a66-29b6f02ed79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94201d17-c5c8-44d8-b1ea-5cec58d30ede", "tag": "102d73ca-2eef-4409-9398-a9a28b924ce4"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:08.436799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=92 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:08.440279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-54683caa-3fb8-4be5-a4ee-4dc0621fd544 req-e673d34f-f969-4327-8a66-29b6f02ed79a service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:08.440782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-54683caa-3fb8-4be5-a4ee-4dc0621fd544 req-e673d34f-f969-4327-8a66-29b6f02ed79a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:08.441420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-54683caa-3fb8-4be5-a4ee-4dc0621fd544 req-e673d34f-f969-4327-8a66-29b6f02ed79a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:08.454155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-54683caa-3fb8-4be5-a4ee-4dc0621fd544 req-e673d34f-f969-4327-8a66-29b6f02ed79a service nova] Creating event network-changed:102d73ca-2eef-4409-9398-a9a28b924ce4 for instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede on hv-cinder-75671 Sep 19 15:11:08.459745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-54683caa-3fb8-4be5-a4ee-4dc0621fd544 req-e673d34f-f969-4327-8a66-29b6f02ed79a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034972 Sep 19 15:11:08.459867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 127/244] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:19.145364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:19.151499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:19.151499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=59 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.151499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.155890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:19.156373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:19.156839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:19.157537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:19.158220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:19.158774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:19.185236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:11:19.542214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-41d14009-4582-418e-8aa8-64811e87365e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 204 len: 0 microversion: 2.1 time: 0.401278 Sep 19 15:11:19.546391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 118/245] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:11:19 2022] DELETE /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:11:19.552304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:19.553223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:19.556313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=16 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:19.562248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:19.562738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:19.563173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:19.563874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:19.564356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:19.564822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:19.733219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:19.742519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-17a5cfd9-0c5a-470f-b895-46ec7444b346 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1553 microversion: 2.1 time: 0.194838 Sep 19 15:11:19.743100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 128/246] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:19 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:20.768069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:20.768799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:20.785829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:20.785829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:20.785829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:20.785829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:20.786201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:20.786201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:20.921940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:20.932189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fc90aeaf-b9ae-447b-9d0b-dda9a4a0257e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1553 microversion: 2.1 time: 0.168321 Sep 19 15:11:20.933410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 119/247] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:20 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:21.955235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:21.962482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:21.970805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:21.971566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:21.972213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:21.973184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:21.973839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:21.974745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:22.232902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:22.242550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-11950e1f-ba94-414f-a315-8ea7bcc2958e tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1553 microversion: 2.1 time: 0.290408 Sep 19 15:11:22.242999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 129/248] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:21 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:23.270438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:23.271916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:23.282119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:23.282934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:23.283609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:23.284570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:23.285361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:23.289209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:23.983896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:23.995280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-04a6308d-faea-4422-bb35-0df874f72766 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1553 microversion: 2.1 time: 0.728798 Sep 19 15:11:23.996328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 120/249] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:23 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1553 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:24.717584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-32766f77-3a5f-4a92-9420-b0b4369dc621 req-2200feeb-3ab3-4570-841f-0030a12a6f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1889b4f-b5a8-45d3-ad20-cbb9566c46a8", "name": "network-vif-deleted", "tag": "eaac7458-d66b-4bba-87e3-a6776b60728b"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:24.760408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-32766f77-3a5f-4a92-9420-b0b4369dc621 req-2200feeb-3ab3-4570-841f-0030a12a6f16 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:24.761168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-32766f77-3a5f-4a92-9420-b0b4369dc621 req-2200feeb-3ab3-4570-841f-0030a12a6f16 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:24.761854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-32766f77-3a5f-4a92-9420-b0b4369dc621 req-2200feeb-3ab3-4570-841f-0030a12a6f16 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:24.783022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-32766f77-3a5f-4a92-9420-b0b4369dc621 req-2200feeb-3ab3-4570-841f-0030a12a6f16 service nova] Creating event network-vif-deleted:eaac7458-d66b-4bba-87e3-a6776b60728b for instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 on hv-cinder-75671 Sep 19 15:11:24.797988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-32766f77-3a5f-4a92-9420-b0b4369dc621 req-2200feeb-3ab3-4570-841f-0030a12a6f16 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088930 Sep 19 15:11:24.799146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 130/250] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:25.019448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:25.020006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:25.032157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:25.033186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:25.034549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:25.036243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:25.037148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:25.037904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:25.211201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:25.225050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-816ac887-c1e7-4afc-86b2-97ec2fe61262 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1346 microversion: 2.1 time: 0.209097 Sep 19 15:11:25.239803 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 121/251] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:25 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:26.250052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:26.250744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:26.259342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:26.260601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:26.261043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:26.261766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:26.262219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:26.262651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:26.301578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:26.302283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:26.302872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:26.303488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lazy-loading 'fault' on Instance uuid f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:11:26.405081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6452ad1301fb4f2aa2f0c015463455c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0871bc1c2b4276afb1d8ad77fda839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:26.417193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b6607aa-25bf-436c-8595-e17be75e8155 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 200 len: 1351 microversion: 2.1 time: 0.170832 Sep 19 15:11:26.418065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 131/252] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:26 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:27.445212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:27.445828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:27.453424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:27.458071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:27.458071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:27.458071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:27.458071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:27.458432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:27.501503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] HTTP exception thrown: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Request method failure captured: Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 HTTP/1.1 Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5OyxFV1gomGQ4PUFrElNiZ_Png-XaNSLlEE6E4EdpSL7a-flKLJD7mY9-8ZvcujyXcJDDQ5Eo68zMoUHcSt4DOfpbiFbkmy5b4yZCja7EGczaXwgUoGsTIfXoRdvwJDHPHCB6ZNnBlmSX-bJXvz8M3rRte7d5IrF2n1bH2IrrV2c Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:11:27.507660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ef0871bc1c2b4276afb1d8ad77fda839"}]}] Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 6452ad1301fb4f2aa2f0c015463455c4 Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.509087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'f1889b4f-b5a8-45d3-ad20-cbb9566c46a8'} Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:11:27.509950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.511146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.516347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Returning 404 to user: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:11:27.516347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7724fa13-0b7c-4f65-8688-766a6b94d040 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 404 len: 111 microversion: 2.1 time: 0.069562 Sep 19 15:11:27.516347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 122/253] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:27 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:11:27.637461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:27.641864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:27.647122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:27.647655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:27.648747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:27.649546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:27.649996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:27.650659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:27.664173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] HTTP exception thrown: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Request method failure captured: Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8/os-volume_attachments HTTP/1.1 Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5OyxFV1gomGQ4PUFrElNiZ_Png-XaNSLlEE6E4EdpSL7a-flKLJD7mY9-8ZvcujyXcJDDQ5Eo68zMoUHcSt4DOfpbiFbkmy5b4yZCja7EGczaXwgUoGsTIfXoRdvwJDHPHCB6ZNnBlmSX-bJXvz8M3rRte7d5IrF2n1bH2IrrV2c Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:11:27.668811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ef0871bc1c2b4276afb1d8ad77fda839"}]}] Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 6452ad1301fb4f2aa2f0c015463455c4 Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.670505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': 'f1889b4f-b5a8-45d3-ad20-cbb9566c46a8'} Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:11:27.671380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:27.672641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:27.674317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Returning 404 to user: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:11:27.674317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-11eb24ff-82b1-47f7-a2b3-930e8abdeda0 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040079 Sep 19 15:11:27.674477 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 132/254] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:11:27 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:11:29.034818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:29.035987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:29.044951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:29.047024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:29.047024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:29.047024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:29.047267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:29.047618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:29.082627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] HTTP exception thrown: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Request method failure captured: Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 HTTP/1.1 Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5OyxFV1gomGQ4PUFrElNiZ_Png-XaNSLlEE6E4EdpSL7a-flKLJD7mY9-8ZvcujyXcJDDQ5Eo68zMoUHcSt4DOfpbiFbkmy5b4yZCja7EGczaXwgUoGsTIfXoRdvwJDHPHCB6ZNnBlmSX-bJXvz8M3rRte7d5IrF2n1bH2IrrV2c Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:11:29.084334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ef0871bc1c2b4276afb1d8ad77fda839"}]}] Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 6452ad1301fb4f2aa2f0c015463455c4 Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.086027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'f1889b4f-b5a8-45d3-ad20-cbb9566c46a8'} Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:11:29.087014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.088090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.089528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Returning 404 to user: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:11:29.089528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4db04dcd-9618-4eac-b366-2fb10a826462 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 404 len: 111 microversion: 2.1 time: 0.055021 Sep 19 15:11:29.091188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 123/255] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:11:29 2022] DELETE /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:11:29.096300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:29.097569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] [instance: f1889b4f-b5a8-45d3-ad20-cbb9566c46a8] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:29.107041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:29.107822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:29.108271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:29.109063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:29.111214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:29.111214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:29.127550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] HTTP exception thrown: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Request method failure captured: Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 HTTP/1.1 Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5OyxFV1gomGQ4PUFrElNiZ_Png-XaNSLlEE6E4EdpSL7a-flKLJD7mY9-8ZvcujyXcJDDQ5Eo68zMoUHcSt4DOfpbiFbkmy5b4yZCja7EGczaXwgUoGsTIfXoRdvwJDHPHCB6ZNnBlmSX-bJXvz8M3rRte7d5IrF2n1bH2IrrV2c Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:11:29.130233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ef0871bc1c2b4276afb1d8ad77fda839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ef0871bc1c2b4276afb1d8ad77fda839"}]}] Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: ef0871bc1c2b4276afb1d8ad77fda839 Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-DeleteServersTestJSON-589456668 Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 6452ad1301fb4f2aa2f0c015463455c4 Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-DeleteServersTestJSON-589456668-project Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.135188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'f1889b4f-b5a8-45d3-ad20-cbb9566c46a8'} Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:11:29.136450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. Sep 19 15:11:29.137845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:11:29.138846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] Returning 404 to user: Instance f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:11:29.138846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a0120377-1b63-4324-937b-c5d54262ea31 tempest-DeleteServersTestJSON-589456668 tempest-DeleteServersTestJSON-589456668-project] 10.222.0.75 "GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8" status: 404 len: 111 microversion: 2.1 time: 0.039710 Sep 19 15:11:29.138846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 133/256] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:29 2022] GET /compute/v2.1/servers/f1889b4f-b5a8-45d3-ad20-cbb9566c46a8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:11:29.239961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2039573969", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "networks": [{"uuid": "3b6bc144-d32e-4406-a24a-376de1fd8c0e"}]}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:29.303659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] validate_networks() for [('3b6bc144-d32e-4406-a24a-376de1fd8c0e', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:11:30.369400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:11:30.370504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:11:30.371196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:11:30.371758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:11:30.372538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:11:30.412320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:30.413766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:30.414501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:30.416649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:30.417278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:30.418718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:30.479493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Getting quotas for project f1bbde55bafa42108676212642d7d3bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:30.490236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Getting quotas for user 0b4ee04a6c6d42fd9bc97d5e356d4a0a and project f1bbde55bafa42108676212642d7d3bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:30.506080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:11:30.509256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:11:30.728558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e1e7f2e8-b231-49e9-8e0c-7f51eb46aa58 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496096 Sep 19 15:11:30.730851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 124/257] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:11:30.741639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fcbb67ed-5dfb-45ae-a635-39fae1766b56 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:30.742844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fcbb67ed-5dfb-45ae-a635-39fae1766b56 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:30.858913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fcbb67ed-5dfb-45ae-a635-39fae1766b56 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:30.896083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fcbb67ed-5dfb-45ae-a635-39fae1766b56 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1219 microversion: 2.1 time: 0.150591 Sep 19 15:11:30.897848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 134/258] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:30 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:31.923401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-98dd9656-9eba-49b7-afe1-eed179dddb48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:31.924723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-98dd9656-9eba-49b7-afe1-eed179dddb48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:32.039276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-98dd9656-9eba-49b7-afe1-eed179dddb48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:32.049360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-98dd9656-9eba-49b7-afe1-eed179dddb48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1219 microversion: 2.1 time: 0.131615 Sep 19 15:11:32.052385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 125/259] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:31 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:33.082518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:33.083141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:33.092631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:33.098657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:33.099120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:33.105309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:33.105849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:33.106304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:33.207859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:33.229489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cd91cb3f-6554-427f-8282-a650b58ebd54 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1271 microversion: 2.1 time: 0.151259 Sep 19 15:11:33.231351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 135/260] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:33 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:34.263781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:34.264427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:34.296395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:34.297163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:34.297742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:34.301527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:34.302388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:34.304850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:34.901915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:34.919427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bdd78280-36dd-47e1-a39c-05cf4c5e2ea0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1279 microversion: 2.1 time: 0.659668 Sep 19 15:11:34.939274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 126/261] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:34 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1279 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:35.949648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:35.949648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:35.955645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:35.956127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:35.962263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:35.963191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:35.963638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:35.964082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:36.239184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:36.251349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b5d9674-2e29-4806-a28f-b6a7be16f9e9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.308761 Sep 19 15:11:36.252317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 136/262] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:35 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:37.281776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:37.282486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:37.294725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:37.295488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:37.297027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:37.299867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:37.301558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:37.302519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:37.654423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:37.666796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-81985921-b2ca-4ba7-acaf-59a92f892050 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.388787 Sep 19 15:11:37.667710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 127/263] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:37 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:38.030502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-15926bb3-af53-47f1-801b-c08318deaa1c req-e80c95f1-82a5-4103-b8e1-05dcf20e93db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9575666b-2db2-40f8-81d8-b08d2a086cce", "tag": "ff4471ce-9801-48a7-9ddd-95ba6abe2556"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:38.041722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-15926bb3-af53-47f1-801b-c08318deaa1c req-e80c95f1-82a5-4103-b8e1-05dcf20e93db service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:38.042205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-15926bb3-af53-47f1-801b-c08318deaa1c req-e80c95f1-82a5-4103-b8e1-05dcf20e93db service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:38.042883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-15926bb3-af53-47f1-801b-c08318deaa1c req-e80c95f1-82a5-4103-b8e1-05dcf20e93db service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:38.055886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-15926bb3-af53-47f1-801b-c08318deaa1c req-e80c95f1-82a5-4103-b8e1-05dcf20e93db service nova] Creating event network-changed:ff4471ce-9801-48a7-9ddd-95ba6abe2556 for instance 9575666b-2db2-40f8-81d8-b08d2a086cce on hv-cinder-75671 Sep 19 15:11:38.063268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-15926bb3-af53-47f1-801b-c08318deaa1c req-e80c95f1-82a5-4103-b8e1-05dcf20e93db service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038232 Sep 19 15:11:38.063933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 128/264] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:11:38.080008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f97c649-e9a4-43ab-bf8c-34e554068bfe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Action: 'create', calling method: .version_select at 0x7f41fb658700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1828862492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTFJxy3VhcSry/vV8THsDUmMKmWh8cmraDa5EwFwzKBfuZYBvcfdFDA7cSFEurKRBC0/Oiy4U0BFNk9tatMyz1vd8nu/tC6vo3qCsIbiz6eQ0/Gnf2uqs0ssf4LCArfeg=="}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:38.101280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-2f97c649-e9a4-43ab-bf8c-34e554068bfe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Getting quotas for project 8b58d25ae1df4454813a0f76db7e4435. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:38.106189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-2f97c649-e9a4-43ab-bf8c-34e554068bfe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Getting quotas for user 578c0a0a8f0544949a4771a651b2ee1e and project 8b58d25ae1df4454813a0f76db7e4435. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:38.208643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f97c649-e9a4-43ab-bf8c-34e554068bfe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.357814 Sep 19 15:11:38.209356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 137/265] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:11:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:38.697203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:38.698360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:38.710105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:38.711407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:38.711847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:38.712579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:38.716211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:38.719675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:39.049801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:39.062564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-30b222fb-c7ff-4d05-ba50-c1a2bc43e308 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.372498 Sep 19 15:11:39.063150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 129/266] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:38 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:40.085493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:40.086138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:40.092867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:40.093341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:40.093772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:40.094456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:40.095102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:40.095698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:40.361188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:40.373339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-82c4bdc2-cb37-4ea8-bb4a-48791f9a13fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.292057 Sep 19 15:11:40.388503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 138/267] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:40 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:41.400955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:41.401598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:41.403992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:41.409626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:41.410109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:41.410542 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:41.411348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:41.411804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:41.412222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:41.606397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:41.619703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-60b0c19e-743f-4b85-ac8d-1bde23012283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.223489 Sep 19 15:11:41.620760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 130/268] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:41 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:42.643897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:42.645460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:42.674378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:42.678593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:42.679663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:42.681908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:42.684289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:42.687672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:43.020080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:43.037657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-97e178bc-9bf2-44bf-97fd-c6d3cf585faa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.398063 Sep 19 15:11:43.038265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 139/269] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:42 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:44.061758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:44.062549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:44.064815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=8 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:44.071339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:44.071875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:44.072355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:44.076367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:44.076367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:44.076367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:44.219839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:44.229466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f4250e83-1cd8-4ec4-8ef6-624b4b78f3b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.171754 Sep 19 15:11:44.230960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 131/270] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:44 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:45.279026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:45.281218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:45.293780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:45.294595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:45.296557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:45.309750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:45.310650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:45.312579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:45.435504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-d4535eee-ef3d-4c87-9843-83cc1e2b7336 req-f3ae8d16-0937-44c4-9984-7c14bf9b857b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575666b-2db2-40f8-81d8-b08d2a086cce", "name": "network-vif-plugged", "status": "completed", "tag": "ff4471ce-9801-48a7-9ddd-95ba6abe2556"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:45.451902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-d4535eee-ef3d-4c87-9843-83cc1e2b7336 req-f3ae8d16-0937-44c4-9984-7c14bf9b857b service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:45.453295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-d4535eee-ef3d-4c87-9843-83cc1e2b7336 req-f3ae8d16-0937-44c4-9984-7c14bf9b857b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:45.453835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-d4535eee-ef3d-4c87-9843-83cc1e2b7336 req-f3ae8d16-0937-44c4-9984-7c14bf9b857b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:45.467761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-d4535eee-ef3d-4c87-9843-83cc1e2b7336 req-f3ae8d16-0937-44c4-9984-7c14bf9b857b service nova] Creating event network-vif-plugged:ff4471ce-9801-48a7-9ddd-95ba6abe2556 for instance 9575666b-2db2-40f8-81d8-b08d2a086cce on hv-cinder-75671 Sep 19 15:11:45.473862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-d4535eee-ef3d-4c87-9843-83cc1e2b7336 req-f3ae8d16-0937-44c4-9984-7c14bf9b857b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042894 Sep 19 15:11:45.475430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 132/271] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:45.535624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:45.560990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7045e5b2-fb22-4f1a-8f19-a80810137221 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.306432 Sep 19 15:11:45.562609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 140/272] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:45 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:46.583067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:46.583720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:46.592582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:46.592845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:46.593457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:46.594426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:46.594875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:46.595680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:46.736235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1774620212", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:46.745583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:46.761894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0877b119-c895-4652-8f35-cc5209ac76dc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.182488 Sep 19 15:11:46.763726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 141/273] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:46 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:46.803837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] validate_networks() for [('54f4077a-9f0c-4643-b263-c7bd1ff20ccb', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:11:47.226998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:11:47.228769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:11:47.229443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:11:47.230013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:11:47.230594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:11:47.243018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:47.243504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:47.243944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:47.244780 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:47.251979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:47.251979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:47.276314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for project 677200be9d434857877c452db7ad4b20. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:47.282935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for user 338bde3096e44d81b2157690c75bfa05 and project 677200be9d434857877c452db7ad4b20. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:47.297378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:11:47.299898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:11:47.418749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4a9e94f0-8ab2-4fac-879e-acdc77d437b9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.852945 Sep 19 15:11:47.419398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 133/274] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:11:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:11:47.431828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b7172ad2-6909-492f-bfbe-6d9f088fbdbc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:47.432448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b7172ad2-6909-492f-bfbe-6d9f088fbdbc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:47.755256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b7172ad2-6909-492f-bfbe-6d9f088fbdbc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:47.767770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b7172ad2-6909-492f-bfbe-6d9f088fbdbc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1222 microversion: 2.1 time: 0.340469 Sep 19 15:11:47.776929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 142/275] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:47 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1222 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:47.787005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:47.789007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:47.806681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:47.809892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:47.810358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:47.811105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:47.811711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:47.812149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:47.952036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-416368213", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:48.004045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:48.016115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bb487c8c-c0d0-4e26-a817-6eabbcfad83d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1319 microversion: 2.1 time: 0.233605 Sep 19 15:11:48.017231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 134/276] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:47 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:48.022046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] validate_networks() for [('54f4077a-9f0c-4643-b263-c7bd1ff20ccb', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:11:48.527046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:11:48.527307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:11:48.527706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:11:48.528441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:11:48.528894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:11:48.732727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:48.732727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:48.732727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:48.732727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:48.733583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:48.733583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:48.733583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for project 677200be9d434857877c452db7ad4b20. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:11:48.733583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for user 338bde3096e44d81b2157690c75bfa05 and project 677200be9d434857877c452db7ad4b20. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:11:48.733922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:11:48.733922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:11:49.002004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bdcbf069-3b19-4334-818b-be88a4892218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.052543 Sep 19 15:11:49.002742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 143/277] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:11:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:11:49.018122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e26eb7ec-3fcf-4640-9929-9667b87e40eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:49.024963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e26eb7ec-3fcf-4640-9929-9667b87e40eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:49.041045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:49.041870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:49.054712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:49.054712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:49.055005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:49.055805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:49.056261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:49.056721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:49.167043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e26eb7ec-3fcf-4640-9929-9667b87e40eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:49.176851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e26eb7ec-3fcf-4640-9929-9667b87e40eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1221 microversion: 2.1 time: 0.163094 Sep 19 15:11:49.193248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 135/278] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:49 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:49.377792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:49.387251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d12d0492-253b-4eee-99f6-c2c9ab1b8c3b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1508 microversion: 2.1 time: 0.351464 Sep 19 15:11:49.388157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 144/279] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:49 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:50.204273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8addafb5-4ed2-4928-99e1-d03d589093c0 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:50.205007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8addafb5-4ed2-4928-99e1-d03d589093c0 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:50.207397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:50.284943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8addafb5-4ed2-4928-99e1-d03d589093c0 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:50.294343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8addafb5-4ed2-4928-99e1-d03d589093c0 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1221 microversion: 2.1 time: 0.093810 Sep 19 15:11:50.296309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 136/280] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:50 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:51.327136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:51.327723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:51.329709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:51.336301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:51.341045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:51.341645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:51.343244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:51.344209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:51.345186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:51.351936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=71 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:51.424990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:51.459538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-75abb2e9-3af5-49e3-9b78-1f61f711206f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1217 microversion: 2.1 time: 0.123887 Sep 19 15:11:51.462255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 145/281] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:51 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:52.488023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:52.490358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:52.499458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:52.500383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:52.501707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:52.503001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:52.503717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:52.504641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:52.648997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:52.648997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1b7a9b25-91a5-450a-8394-7d684be747ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1281 microversion: 2.1 time: 0.161330 Sep 19 15:11:52.648997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 137/282] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:52 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:53.220993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-1ee1224c-81d4-44bd-8442-3fe32913377a req-9eab02e2-9638-49a0-8c54-c8b13ab5ea75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0ce04e-f5c6-42b8-bbac-8ab27d3df274", "tag": "3877f386-6e61-4be6-9038-2805e12927a6"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:53.232713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-1ee1224c-81d4-44bd-8442-3fe32913377a req-9eab02e2-9638-49a0-8c54-c8b13ab5ea75 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.233196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-1ee1224c-81d4-44bd-8442-3fe32913377a req-9eab02e2-9638-49a0-8c54-c8b13ab5ea75 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.233631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-1ee1224c-81d4-44bd-8442-3fe32913377a req-9eab02e2-9638-49a0-8c54-c8b13ab5ea75 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.246785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-1ee1224c-81d4-44bd-8442-3fe32913377a req-9eab02e2-9638-49a0-8c54-c8b13ab5ea75 service nova] Creating event network-changed:3877f386-6e61-4be6-9038-2805e12927a6 for instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 on hv-cinder-75671 Sep 19 15:11:53.251707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-1ee1224c-81d4-44bd-8442-3fe32913377a req-9eab02e2-9638-49a0-8c54-c8b13ab5ea75 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034442 Sep 19 15:11:53.252322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 146/283] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:53.676599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:53.678086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:53.699242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.699750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.700195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.700938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:53.701400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:53.701826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:53.706404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:53.906451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:53.917081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d7d03336-22ce-4b70-a421-ad6cb3a29c82 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.246937 Sep 19 15:11:53.918277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 138/284] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:53 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:54.340590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-92f449e5-992b-42f1-ae8d-8fb6a9172a99 req-93fd0136-808b-435f-81f8-6e61b0bd4822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76", "tag": "21cce671-3b51-418b-84fa-c3068a42f75e"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:11:54.351222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-92f449e5-992b-42f1-ae8d-8fb6a9172a99 req-93fd0136-808b-435f-81f8-6e61b0bd4822 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.351799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-92f449e5-992b-42f1-ae8d-8fb6a9172a99 req-93fd0136-808b-435f-81f8-6e61b0bd4822 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.352220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-92f449e5-992b-42f1-ae8d-8fb6a9172a99 req-93fd0136-808b-435f-81f8-6e61b0bd4822 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.367479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-92f449e5-992b-42f1-ae8d-8fb6a9172a99 req-93fd0136-808b-435f-81f8-6e61b0bd4822 service nova] Creating event network-changed:21cce671-3b51-418b-84fa-c3068a42f75e for instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 on hv-cinder-75671 Sep 19 15:11:54.372607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-92f449e5-992b-42f1-ae8d-8fb6a9172a99 req-93fd0136-808b-435f-81f8-6e61b0bd4822 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036860 Sep 19 15:11:54.373253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 147/285] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:11:54.945455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:54.946065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:54.953352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.953846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.954285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:54.954987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:54.955443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:54.955871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:55.097296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:55.106112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b2b4dfad-551e-454d-b22f-acd01939529d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.164688 Sep 19 15:11:55.106678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 139/286] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:54 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:56.128621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:56.129312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:56.140831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:56.144161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:56.144161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:56.144161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:56.144161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:56.145169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:56.304580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:56.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fec65b6e-d2ec-47f2-9a7b-50347a5111c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.187028 Sep 19 15:11:56.312098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 148/287] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:56 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:57.334462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:57.342619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:57.342619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:57.344424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:57.344952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:57.345390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.346099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:57.346552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:57.346973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:57.631706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:57.640814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-744453ce-f2c5-411d-9132-342731a27160 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.310389 Sep 19 15:11:57.641396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 140/288] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:57 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:11:58.663655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:58.664359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:58.666427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:58.667105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=14 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:11:58.671868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.672353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.672820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.673519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:58.673978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:58.674405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:58.807688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:58.815281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7f7c122b-1d6a-407c-a8b9-ac64e53ec733 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.155665 Sep 19 15:11:58.815840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 149/289] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:58 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:11:59.838226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:11:59.839074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:11:59.847074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:59.847900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:59.848695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:59.849628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:11:59.850773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:11:59.852345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:11:59.991493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:11:59.999785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cba23e2a-1b72-4dc3-be39-3b1d7b13905a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.165615 Sep 19 15:12:00.000355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 141/290] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:11:59 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:01.023236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:01.024710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:01.030873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:01.031355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:01.031793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.032508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:01.032973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:01.033379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:01.192379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:01.200778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b8c689dd-58c8-4352-b41c-877a0a95a482 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.181486 Sep 19 15:12:01.201342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 150/291] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:01 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:02.224311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:02.225241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:02.228451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=10 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:02.233721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.234216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.239954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.239954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:02.239954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:02.239954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:02.395735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:02.404315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-072698d1-09b3-4949-995d-9aea7143e0ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.183771 Sep 19 15:12:02.406270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 142/292] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:02 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:03.427237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:03.427957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:03.434366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:03.434864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:03.435294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:03.435992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:03.436444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:03.437067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:03.575950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:03.583690 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-84d68440-e4b3-48ee-9518-e1836d0f4f55 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.160330 Sep 19 15:12:03.584254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 151/293] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:03 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:04.607903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:04.608635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:04.615139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:04.615581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:04.616012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:04.616732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:04.617216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:04.618036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:04.751838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:04.761775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-69d766d2-05df-4263-910a-a8a81b024fd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.157672 Sep 19 15:12:04.764638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 143/294] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:04 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:05.785927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:05.786542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:05.793292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:05.793775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:05.794227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:05.794918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:05.795412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:05.795837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:05.939582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:05.947694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-af80af20-763c-4a80-ae48-c8cc14aa4288 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.165685 Sep 19 15:12:05.948266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 152/295] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:05 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:06.971075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:06.971693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:06.978265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:06.978901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:06.979344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:06.980047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:06.980523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:06.980959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:07.117081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:07.125078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-be6bb232-e661-4716-81e1-774fe991b661 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.158032 Sep 19 15:12:07.125650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 144/296] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:06 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:08.146989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:08.147610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:08.157463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:08.157948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:08.158371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:08.159076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:08.159556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:08.160009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:08.310749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:08.318367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2235f6f9-c379-4e18-a5eb-a0fde78769f3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.175213 Sep 19 15:12:08.318928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 153/297] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:08 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:08.487883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-c30b797c-0e0f-4a42-9984-3888bb6a91d2 req-21e9cea0-2387-461f-8c7b-7b9c21742e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0ce04e-f5c6-42b8-bbac-8ab27d3df274", "name": "network-vif-plugged", "status": "completed", "tag": "3877f386-6e61-4be6-9038-2805e12927a6"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:08.522061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c30b797c-0e0f-4a42-9984-3888bb6a91d2 req-21e9cea0-2387-461f-8c7b-7b9c21742e9b service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:08.522559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c30b797c-0e0f-4a42-9984-3888bb6a91d2 req-21e9cea0-2387-461f-8c7b-7b9c21742e9b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:08.532429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c30b797c-0e0f-4a42-9984-3888bb6a91d2 req-21e9cea0-2387-461f-8c7b-7b9c21742e9b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:08.537288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-c30b797c-0e0f-4a42-9984-3888bb6a91d2 req-21e9cea0-2387-461f-8c7b-7b9c21742e9b service nova] Creating event network-vif-plugged:3877f386-6e61-4be6-9038-2805e12927a6 for instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 on hv-cinder-75671 Sep 19 15:12:08.544410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-c30b797c-0e0f-4a42-9984-3888bb6a91d2 req-21e9cea0-2387-461f-8c7b-7b9c21742e9b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059914 Sep 19 15:12:08.545021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 145/298] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:09.345579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:09.345579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:09.349328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:09.349888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:09.350399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:09.351428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:09.352517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:09.352956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:09.490815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:09.498644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bafca370-85cb-452e-9a74-4910bba59e6f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.160357 Sep 19 15:12:09.499225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 154/299] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:09 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:10.521713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:10.522507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:10.529581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.530053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.530488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.531382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:10.531836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:10.532264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:10.692468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:10.700613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e9c05fe-f963-41b5-abfa-ff0d60167ea5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.183545 Sep 19 15:12:10.708548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 146/300] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:10 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:11.754641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:11.756546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:11.779018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:11.779521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:11.779968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:11.780716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:11.781331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:11.781767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:11.974621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:11.987598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d08ae756-1627-40f6-a530-d540c672e49c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.260596 Sep 19 15:12:11.992895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 155/301] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:11 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:13.013640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:13.014246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:13.022881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:13.025201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:13.025977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:13.026916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:13.027639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:13.028345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:13.198941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:13.208251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-790d5646-de18-4937-a367-f67575b2edd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.198385 Sep 19 15:12:13.209519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 147/302] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:13 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:14.232380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:14.233201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:14.239347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.240047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.240666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.241433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:14.241968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:14.242730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:14.405175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:14.420635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f7a5881f-8704-44e7-94d2-3d7eeb0c73c1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.191977 Sep 19 15:12:14.421996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 156/303] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:14 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:15.448492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:15.449771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:15.458020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:15.458663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:15.459227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:15.460040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:15.460695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:15.461802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:15.636090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:15.643985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0fa33b33-5d5a-4939-9a08-949298eec93f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.199543 Sep 19 15:12:15.660923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 148/304] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:15 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:16.120401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-0810e4ad-560d-4aca-a91d-38b8b50cfab1 req-1eb4351e-800e-4c81-932f-9d95ca6d89be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76", "name": "network-vif-plugged", "status": "completed", "tag": "21cce671-3b51-418b-84fa-c3068a42f75e"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:16.130409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-0810e4ad-560d-4aca-a91d-38b8b50cfab1 req-1eb4351e-800e-4c81-932f-9d95ca6d89be service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:16.130884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-0810e4ad-560d-4aca-a91d-38b8b50cfab1 req-1eb4351e-800e-4c81-932f-9d95ca6d89be service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:16.131312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-0810e4ad-560d-4aca-a91d-38b8b50cfab1 req-1eb4351e-800e-4c81-932f-9d95ca6d89be service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:16.144116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-0810e4ad-560d-4aca-a91d-38b8b50cfab1 req-1eb4351e-800e-4c81-932f-9d95ca6d89be service nova] Creating event network-vif-plugged:21cce671-3b51-418b-84fa-c3068a42f75e for instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 on hv-cinder-75671 Sep 19 15:12:16.149965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-0810e4ad-560d-4aca-a91d-38b8b50cfab1 req-1eb4351e-800e-4c81-932f-9d95ca6d89be service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034215 Sep 19 15:12:16.150552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 157/305] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:16.669638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:16.670577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:16.676927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:16.677489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:16.678133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:16.681917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:16.681917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:16.681917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:16.862828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:16.871762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b41174e4-27a9-4c30-9700-eb4be2430f8f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.207374 Sep 19 15:12:16.872336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 149/306] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:16 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:17.900317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:17.905253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:17.914757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.915458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.916047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:17.917072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:17.917517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:17.918436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:18.126937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:18.147951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-84598531-484b-4e26-bee3-e1d9fffe6166 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.256581 Sep 19 15:12:18.148865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 158/307] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:17 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:19.175361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:19.176626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:19.185560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:19.186713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:19.187357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:19.188879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:19.189554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:19.190160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:19.526347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:19.534147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d55c3182-07cb-4747-a020-39af3c99863c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1321 microversion: 2.1 time: 0.365252 Sep 19 15:12:19.534939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 150/308] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:19 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:20.559338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:20.561060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:20.567140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:20.567636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:20.568212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:20.568950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:20.569412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:20.569841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:20.776652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:20.788239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ccd937c9-69e5-4bdd-af00-e85851a2dee3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1515 microversion: 2.1 time: 0.233500 Sep 19 15:12:20.789621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 159/309] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:20 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:20.815718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:20.823136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:20.831269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:20.832377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:20.833148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:20.834079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:20.834709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:20.835267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:20.877920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lazy-loading 'flavor' on Instance uuid f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:12:21.261391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c5f263c1-434c-4aa0-aa3e-0787814e62aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76/action" status: 200 len: 32 microversion: 2.1 time: 0.449600 Sep 19 15:12:21.262429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 151/310] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:12:20 2022] POST /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76/action => generated 32 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:12:21.272552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:21.274078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:21.281101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:21.281592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:21.282264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:21.283212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:21.283819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:21.284421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:21.479120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:21.489083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5f12ab4a-9355-4b11-9cf2-2d9c6b2fc7ca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.220312 Sep 19 15:12:21.489883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 160/311] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:21 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:22.517148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:22.518577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:22.525656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:22.528466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:22.528466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:22.528466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:22.528466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:22.529160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:22.678138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:22.687049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-83a063ef-ffdf-4eea-99f4-2b5b8a1a52d5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.175236 Sep 19 15:12:22.687719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 152/312] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:22 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:23.710378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:23.711962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:23.717920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:23.718512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:23.719023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:23.719789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:23.720323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:23.720846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:23.724920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=84 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:23.871148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:23.878964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-48350b27-9b62-4cc9-a5b3-b89b4a2cd218 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.172361 Sep 19 15:12:23.879522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 161/313] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:23 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:23.971280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7ad51a9c-cc69-4d23-a900-923610295074 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Action: 'create', calling method: .version_select at 0x7f41fb615dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2133944848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFECJEj2MkxRkbZltYZJBcN2j9XNfo/k90m32jJLF2DCFr7OEuo7Pixoga4IuG+c4QkUrfAuhJrQy35B1PdKCvdQewyv5tRdqbgXglVxdslyuIHUDvl8jdFB5uqIwQwLqA=="}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:23.977122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=36 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:23.987258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-7ad51a9c-cc69-4d23-a900-923610295074 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Getting quotas for project 44cfaa7a9ec843e1a26460270f99a9e2. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:12:23.990951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-7ad51a9c-cc69-4d23-a900-923610295074 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Getting quotas for user c0121ba668034aac98863a2caf80320e and project 44cfaa7a9ec843e1a26460270f99a9e2. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:12:24.086670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7ad51a9c-cc69-4d23-a900-923610295074 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.290929 Sep 19 15:12:24.087460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 153/314] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:12:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:12:24.902557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:24.903666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:24.905564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=34 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:24.910117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:24.910608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:24.911124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:24.911718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:24.912169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:24.912618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:25.064089 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:25.073099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4da5cb93-8f37-463f-8342-c8f0cf72a35f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.174552 Sep 19 15:12:25.073856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 162/315] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:24 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:26.098217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:26.098835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:26.106592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:26.107074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:26.110137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:26.110137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:26.110137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:26.110137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:26.111918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:26.280373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:26.288153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-88fdf26d-ab9a-47ee-9111-bdbd1af76ff4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.194182 Sep 19 15:12:26.293132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 154/316] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:26 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:26.745839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-397424010", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1828862492", "security_groups": [{"name": "tempest-secgroup-smoke-70940225"}], "networks": [{"uuid": "48a0dab0-e097-495c-973a-7f711798e008"}], "block_device_mapping_v2": [{"uuid": "c63c12cc-c67a-4a90-a133-e198ac43b96a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:26.977000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] validate_networks() for [('48a0dab0-e097-495c-973a-7f711798e008', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:12:27.313970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:27.314586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:27.325085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:27.325576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:27.326020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:27.326942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:27.327404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:27.327981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:27.607082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:27.620974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2013a124-a0de-4595-af41-43b3e6f010f7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.310877 Sep 19 15:12:27.622426 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 155/317] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:27 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:12:27.651297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:12:27.656768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:12:27.656768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:12:27.656768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:12:27.656768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:12:27.662194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:27.662683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:27.663309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:27.664781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:27.665261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:27.665795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:27.684722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Getting quotas for project 8b58d25ae1df4454813a0f76db7e4435. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:12:27.689010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Getting quotas for user 578c0a0a8f0544949a4771a651b2ee1e and project 8b58d25ae1df4454813a0f76db7e4435. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:12:27.769502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:12:27.771817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c63c12cc-c67a-4a90-a133-e198ac43b96a',volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:12:28.267789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-80fb75b3-909a-4438-b0c3-961aa7fee5ad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.526142 Sep 19 15:12:28.269493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 163/318] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:12:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:12:28.281737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cd2bb1a9-610f-4bea-8ca0-ef4d4b9e3e48 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:28.282531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cd2bb1a9-610f-4bea-8ca0-ef4d4b9e3e48 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:28.394510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cd2bb1a9-610f-4bea-8ca0-ef4d4b9e3e48 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:28.403022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cd2bb1a9-610f-4bea-8ca0-ef4d4b9e3e48 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1088 microversion: 2.1 time: 0.126700 Sep 19 15:12:28.403780 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 156/319] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1088 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:28.645688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:28.646426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:28.653469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:28.654052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:28.654547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:28.655233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:28.655688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:28.656113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:28.829730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:28.837874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9f2c89da-29e0-4050-8ce9-8f41369a4a47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.196007 Sep 19 15:12:28.838625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 164/320] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:28 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:29.428786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:29.429451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:29.437598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:29.441198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:29.441198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:29.441198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:29.441198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:29.441733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:29.511744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:29.518303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3b37bf83-4c59-4290-8c80-ed7d54d08a02 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1138 microversion: 2.1 time: 0.093429 Sep 19 15:12:29.524187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 157/321] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:29.861229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:29.861770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:29.867638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:29.868123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:29.868579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:29.869272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:29.869727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:29.870149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:30.008526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:30.017819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d6ce74b6-3d29-4886-8cdb-5d4552e2d78c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.160365 Sep 19 15:12:30.019430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 165/322] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:29 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:30.119158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef7e01c2-1f2a-4272-a7b7-0168d1b2baff", "device": "/dev/sdb"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:30.122812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:30.129181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:30.129667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:30.130093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:30.130788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:30.131241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:30.131663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:30.547283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:30.555318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:30.559076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:30.559569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:30.560114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:30.560740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:30.561199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:30.561627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:30.639040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:30.647290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d87ea5eb-8bf9-4ea8-a736-46067cad2067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1186 microversion: 2.1 time: 0.107913 Sep 19 15:12:30.648002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 166/323] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:30.937217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-08aa90df-6276-47b0-8ae4-446b0454b5d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "POST /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818001 Sep 19 15:12:30.937217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 158/324] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:12:30 2022] POST /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:31.046243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:31.047419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:31.054151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:31.054692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:31.055406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:31.056114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:31.056666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:31.057092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:31.242244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:31.251731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2c0e8b06-4203-4a82-828a-164796eea84d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.209559 Sep 19 15:12:31.252750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 167/325] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:31 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:31.673265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:31.673995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:31.681300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:31.682303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:31.682303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:31.682954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:31.683409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:31.683830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:31.761949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:31.771433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e6f2097a-2390-485c-bea8-411f154dbdc0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1204 microversion: 2.1 time: 0.102941 Sep 19 15:12:31.772993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 159/326] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:32.282655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:32.284188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:32.291465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:32.292183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:32.292658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:32.293367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:32.293821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:32.294245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:32.439819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:32.449390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-13999d34-6a69-41de-9098-4146827a9b29 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.177803 Sep 19 15:12:32.449947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 168/327] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:32 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:32.796921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:32.798280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:32.806205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:32.807018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:32.807500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:32.808508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:32.809065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:32.809529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:32.990899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:32.998861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-199f8a76-7c98-4ed8-b0f9-0b60ce8c444b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.206088 Sep 19 15:12:32.999438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 160/328] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:33.207724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-d9e98f6c-c389-467b-98dc-461b77cdd6af req-67b444e3-5377-4186-bc8e-30b0bb5a8eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31955ace-a21d-4a42-8e97-33da4bca71f0", "tag": "a7905d0d-ddbc-4310-b98e-9d7db60cfd0d"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:12:33.219710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d9e98f6c-c389-467b-98dc-461b77cdd6af req-67b444e3-5377-4186-bc8e-30b0bb5a8eab service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:33.220327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d9e98f6c-c389-467b-98dc-461b77cdd6af req-67b444e3-5377-4186-bc8e-30b0bb5a8eab service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:33.220849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d9e98f6c-c389-467b-98dc-461b77cdd6af req-67b444e3-5377-4186-bc8e-30b0bb5a8eab service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:33.239719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-d9e98f6c-c389-467b-98dc-461b77cdd6af req-67b444e3-5377-4186-bc8e-30b0bb5a8eab service nova] Creating event network-changed:a7905d0d-ddbc-4310-b98e-9d7db60cfd0d for instance 31955ace-a21d-4a42-8e97-33da4bca71f0 on hv-cinder-75671 Sep 19 15:12:33.245838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-d9e98f6c-c389-467b-98dc-461b77cdd6af req-67b444e3-5377-4186-bc8e-30b0bb5a8eab service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044385 Sep 19 15:12:33.247208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 169/329] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:12:33.478086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:33.478617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:33.484743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:33.485369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:33.485759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:33.486394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:33.487272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:33.487748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:33.643422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:33.651540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d0ba9ddf-5856-45e5-b8ef-a551c67bd0eb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.178513 Sep 19 15:12:33.652113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 161/330] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:33 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:34.024662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:34.025377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:34.040204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:34.040766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:34.041205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:34.041949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:34.042411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:34.042838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:34.181484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:34.193144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b2a380d5-fd0c-4729-8572-a10b9d3f80b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.173795 Sep 19 15:12:34.193805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 170/331] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:34.675274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:34.675977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:34.682697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:34.683179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:34.683616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:34.684323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:34.684813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:34.685244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:34.815974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:34.823733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7fe11032-b7a0-4a8a-927e-bec1a51f55b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.152488 Sep 19 15:12:34.824305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 162/332] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:34 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:35.216466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:35.217248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:35.223250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:35.223793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:35.224263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:35.225007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:35.225457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:35.225873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:35.364276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:35.372121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2ed125a7-1c6f-4144-bc09-edd2e8362c24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.159603 Sep 19 15:12:35.372713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 171/333] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:35.846936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:35.847550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:35.854875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:35.855361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:35.855802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:35.856528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:35.856992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:35.857424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:35.988612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:35.996458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-675f8d41-9a7e-4ca4-a703-f26e535ea846 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.153435 Sep 19 15:12:35.997058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 163/334] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:35 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:36.395407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:36.396018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:36.402386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:36.402879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:36.403317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:36.404006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:36.404459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:36.405050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:36.541789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:36.549371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e5b65391-354e-44b3-a0a7-ee161d3cbbbb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.158074 Sep 19 15:12:36.549933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 172/335] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:37.020141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:37.020751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:37.027810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.028299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.028766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.029466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.029924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.030354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.176151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:37.184680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-43fd7c62-376f-47af-962d-0cf36d73e891 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.168458 Sep 19 15:12:37.185269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 164/336] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:37 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:37.574639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:37.575256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:37.581267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.581777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.582213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.582899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:37.583442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:37.583786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:37.673471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:37.696231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=6 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:37.716759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:37.724791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2111ff3f-bc25-4146-96f4-76920f85a629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.155630 Sep 19 15:12:37.725341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 173/337] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:38.208307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:38.208851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:38.215932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.216368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.216840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.217543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.217996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.218418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.358051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:38.365904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bde03b93-9417-4e61-b344-abb8edb0ccca tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.161659 Sep 19 15:12:38.366464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 165/338] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:38 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:38.748936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:38.750187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:38.756801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.757298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.757736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.758437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:38.758897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:38.759326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:38.898956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:38.907242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-592cf6d3-4075-4ec5-bb93-c49a43954003 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.162922 Sep 19 15:12:38.907811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 174/339] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:39.390324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:39.390917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:39.392892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:39.398022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:39.403566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:39.403566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:39.403566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:39.403566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:39.403960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:39.556636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:39.566358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f25047b8-1f83-4e7d-9068-caa52f5475fd tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.179956 Sep 19 15:12:39.566920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 166/340] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:39 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:39.930501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:39.931133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:39.937676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:39.938172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:39.938607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:39.939356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:39.939811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:39.940233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:40.080389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:40.089575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e471af78-bce5-480a-9650-132c01478c41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1270 microversion: 2.1 time: 0.161971 Sep 19 15:12:40.090158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 175/341] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:40.592823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:40.593439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:40.599912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:40.600403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:40.600868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:40.601830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:40.602283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:40.602708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:40.741108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:40.749521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2fd289b0-9f88-4efb-989b-b8a262818230 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.161424 Sep 19 15:12:40.750091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 167/342] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:40 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:41.119844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:41.120459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:41.126535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.127020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.127458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.128149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.128649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.129075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.263099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:41.270726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-43dad9bc-e60d-48d3-a82a-9ca214bb8d29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.154805 Sep 19 15:12:41.271281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 176/343] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:41.773134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:41.773739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:41.780866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.781347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.781777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.782469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:41.782918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:41.783336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:41.917977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:41.925618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9f87d98a-2790-4aa4-a181-3159af60a402 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.156326 Sep 19 15:12:41.926176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 168/344] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:41 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:42.293707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:42.294268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:42.300743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:42.301221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:42.301651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:42.302331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:42.302780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:42.303218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:42.444432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:42.452056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-755442dc-9126-4667-8da8-c2c1aa4133c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.162296 Sep 19 15:12:42.452825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 177/345] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:42.950000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:42.951401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:42.958201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:42.958683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:42.959112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:42.959810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:42.960255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:42.960734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.091765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:43.099571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b8424442-6556-4f5c-9e18-fe2598b43f20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.154100 Sep 19 15:12:43.100160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 169/346] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:42 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:43.475717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:43.476360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:43.483575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:43.484063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:43.484523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.485220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:43.485674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:43.486095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:43.639422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:43.647284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b3dd9d9f-09cc-4cb4-a767-9bc3f203c682 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.175680 Sep 19 15:12:43.647840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 178/347] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:44.123381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:44.123992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:44.130502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.130988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.131425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.132124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.132609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.133041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.147912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:44.269395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:44.276913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-00026845-7c88-431b-8be2-97ffa7dee480 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.157547 Sep 19 15:12:44.277490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 170/348] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:44 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:44.671307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:44.671946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:44.678051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.678536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.678977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.679675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:44.680159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:44.680627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:44.683178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:44.810890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:44.818469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dcfbcede-0998-4716-bf80-e18cdb7b39ef tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.151823 Sep 19 15:12:44.819023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 179/349] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:45.300319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:45.300978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:45.307333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:45.307812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:45.308247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.308969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:45.309429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:45.309853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.441541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:45.449204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-65ab06af-cbd0-468d-95c3-cdbcec55bb03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.152760 Sep 19 15:12:45.449766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 171/350] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:45 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:45.842507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:45.843119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:45.849009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:45.849490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:45.849921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.850609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:45.851060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:45.851481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:45.983910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:45.991602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f6d98973-1453-47e8-a9bf-2097e9649bd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.153879 Sep 19 15:12:45.992202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 180/351] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:46.473132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:46.473655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:46.480839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.481337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.482299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.483218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:46.483675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:46.484169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:46.618178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:46.625829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5ca9a2f8-2453-4026-a88d-a3dcda8d2fa5 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.156687 Sep 19 15:12:46.626391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 172/352] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:46 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:47.014860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:47.015397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:47.021332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:47.021804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:47.022231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:47.022911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:47.023356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:47.023773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:47.152566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:47.160836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1394cd3e-d57b-42f3-8680-2ca4153bc0fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.150422 Sep 19 15:12:47.161392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 181/353] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:47.648237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:47.648862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:47.655447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:47.655923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:47.656354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:47.657065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:47.657515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:47.657937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:47.788463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:47.796239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-48048f5a-4c1a-4480-a2e3-a84df5b0f3d6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.151869 Sep 19 15:12:47.796830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 173/354] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:47 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:48.183599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:48.184194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:48.191100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.191585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.192019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.192738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.193218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.193640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.329295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:48.337329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0179245f-db8a-4cb0-953e-565d58a1e25e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.157534 Sep 19 15:12:48.337905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 182/355] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:48.818908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:48.819713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:48.826243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.826722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.827152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.827838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:48.828288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:48.828738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:48.962238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:48.970608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0cba2317-642c-461a-a394-4d99dee79c58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.155802 Sep 19 15:12:48.971169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 174/356] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:48 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:49.360927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:49.361466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:49.367376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:49.367888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:49.368322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:49.369038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:49.369495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:49.369918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:49.501846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:49.509514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d646e6da-0a09-4a55-b5af-a37a07163dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.152656 Sep 19 15:12:49.510034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 183/357] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:49.995785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:49.996438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:50.003916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:50.004399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:50.004866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:50.005562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:50.006177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:50.006630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:50.167351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:50.175771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7713ce9e-c82f-4c3d-9de0-797e8d853542 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.184757 Sep 19 15:12:50.176765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 175/358] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:49 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:50.535374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:50.535988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:50.543682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:50.544176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:50.545322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:50.545924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:50.546380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:50.546809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:50.701160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:50.709516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0267dd85-ea5a-4ace-9813-dad606ae3d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.180868 Sep 19 15:12:50.710093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 184/359] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:51.202700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:51.203311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:51.209735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.210421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.211027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.211755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.212213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.212666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.351754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:51.360187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1501cf0d-11dd-40d8-83d0-347e2012204d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.161195 Sep 19 15:12:51.361021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 176/360] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:51 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:51.733340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:51.734279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:51.740948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.742510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.744264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.751230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:51.751230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:51.751230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:51.887872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:51.898960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-73383bf5-63de-4d67-b405-5b49b470d256 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.169706 Sep 19 15:12:51.899277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 185/361] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:52.383366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:52.383972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:52.390593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:52.391071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:52.391498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:52.392184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:52.392690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:52.393113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:52.527064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:52.535721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-749a1c57-e038-44f1-93b3-88382dfae450 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.156403 Sep 19 15:12:52.536302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 177/362] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:52 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:52.921775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:52.922378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:52.928198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:52.928715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:52.929170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:52.929952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:52.930406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:52.930820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:53.068558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:53.077766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1993ebad-ccca-4a1d-b14d-c271746f61b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.160489 Sep 19 15:12:53.078344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 186/363] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:53.559132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:53.559737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:53.566707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:53.567182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:53.567614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:53.568301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:53.568837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:53.569209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:53.934127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:53.942260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-897632ba-8ac2-47a4-8389-e3e1ed506354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.386974 Sep 19 15:12:53.942822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 178/364] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:53 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:54.100405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:54.101113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:54.107995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:54.108560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:54.109059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:54.109819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:54.110334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:54.110834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:54.237616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:54.245268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-48a83d20-a149-42bc-9cb2-bd0dd71d70b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.148771 Sep 19 15:12:54.245825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 187/365] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:54.964845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:54.965473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:54.967816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:54.972588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:54.973095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:54.973511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:54.974209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:54.974667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:54.975096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:55.112234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:55.120197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-75ad1470-f2b3-4d42-8830-d1d42ed9166e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.159206 Sep 19 15:12:55.120836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 179/366] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:54 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:55.267744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:55.268351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:55.270241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:12:55.274915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:55.275401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:55.275834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:55.276552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:55.277011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:55.277491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:55.406514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:55.414305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-45c109dd-3c9e-4428-8234-c87d188567c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.150452 Sep 19 15:12:55.414864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 188/367] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:56.143751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:56.144405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:56.150836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:56.151326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:56.151763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:56.152455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:56.152938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:56.153372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:56.288125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:56.295320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e9bb2fb4-cedb-48d1-87aa-2a96f4966e58 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.155144 Sep 19 15:12:56.295946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 180/368] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:56 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:56.438209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:56.438969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:56.445013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:56.450318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:56.450318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:56.450318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:56.450318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:56.451464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:56.588757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:56.597001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f8b1a34f-46c2-4e7b-89f4-00816fc16bf8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.163143 Sep 19 15:12:56.597629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 189/369] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:57.318034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:57.318642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:57.325024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.326137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.326753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:57.327446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.327900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.328325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:57.456392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:57.463988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2b4cdb6-2a26-40b7-b938-3a85b5c7caa7 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.149832 Sep 19 15:12:57.464559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 181/370] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:57 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:57.620746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:57.621341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:57.627768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.628241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.628714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:57.629402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:57.629843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:57.630258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:57.765052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:57.773305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-acb763fb-83c0-482d-9374-3263abf40f2b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.156302 Sep 19 15:12:57.773872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 190/371] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:58.487906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:58.488558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:58.495196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:58.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:58.496118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:58.496851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:58.497317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:58.498371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:58.631618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:58.640501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-88c2bfd9-b207-4822-8ed3-b583369a1614 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.156408 Sep 19 15:12:58.641068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 182/372] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:58 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:58.802945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:58.803544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:58.809638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:58.810324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:58.810798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:58.811491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:58.811941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:58.812369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:58.945496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:58.954155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d19c9ad8-0110-4337-97d6-f53af6de9be4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.155100 Sep 19 15:12:58.954711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 191/373] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:59.662974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:59.663586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:59.670631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:59.671195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:59.671627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:59.672317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:59.672791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:59.673227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:59.805585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:12:59.813641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2bccfc80-9f62-4f91-9ecf-0236c65f567a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.154490 Sep 19 15:12:59.814210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 183/374] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:59 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:12:59.980872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:12:59.981571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:12:59.987584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:59.988095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:59.988558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:12:59.989253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:12:59.989707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:12:59.990134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:00.117462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:00.125854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ceb6c8bc-bcd8-4d9a-a986-856a7a6db8e3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.149139 Sep 19 15:13:00.126429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 192/375] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:12:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:00.837044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:00.837648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:00.844854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:00.845331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:00.845766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:00.846447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:00.846896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:00.847316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:00.981754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:00.990513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-46eeba0f-bd70-4bc9-8e80-f39c656fb75c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.157322 Sep 19 15:13:00.991114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 184/376] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:00 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:01.149405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:01.150034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:01.156319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:01.156840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:01.157276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:01.157960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:01.158416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:01.158835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:01.288727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:01.296675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b3be3813-e4c0-4133-8a1e-27b0f7b99b80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.151428 Sep 19 15:13:01.297219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 193/377] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:02.012957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:02.013865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:02.020263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:02.020945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:02.021387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:02.024119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:02.024119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:02.024119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:02.154440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:02.162214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea53df79-17a6-40f8-9e46-090b0523550d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.153153 Sep 19 15:13:02.162788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 185/378] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:02 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:02.324853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:02.325457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:02.331770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:02.332252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:02.342069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:02.342069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:02.342069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:02.342069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:02.472144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:02.480356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d1e8787-b840-42b4-a519-b4555aff7538 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.159370 Sep 19 15:13:02.480946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 194/379] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:03.185583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:03.186195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:03.192863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:03.193354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:03.193795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:03.194501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:03.194962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:03.195394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:03.323464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:03.331823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f49bf727-1a1f-4416-ab33-f4c28d106917 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.150017 Sep 19 15:13:03.332387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 186/380] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:03 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:03.503279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:03.503891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:03.510233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:03.510719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:03.511157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:03.511846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:03.512304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:03.512774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:03.651000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:03.653216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:03.659853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cfea1286-1bc2-4146-b61b-52e6265c7144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.160517 Sep 19 15:13:03.660412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 195/381] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:04.355583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:04.356207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:04.363256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:04.363752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:04.364194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:04.364921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:04.365377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:04.365804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:04.368390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:04.502770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:04.510444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3fa041f8-1ef1-4b11-8754-21ee55566354 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.159093 Sep 19 15:13:04.511012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 187/382] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:04 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:04.684909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:04.685519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:04.692782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:04.693831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:04.693831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:04.694780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:04.695330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:04.695781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:04.832751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:04.840504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bcea7615-b716-4153-a659-c5dcb4ccae46 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.159905 Sep 19 15:13:04.841063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 196/383] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:05.533276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:05.533921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:05.540234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:05.540756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:05.541199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:05.541893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:05.542358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:05.542784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:05.672693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:05.681301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0b830f4a-04f2-4a70-87ed-c51239c67049 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.152038 Sep 19 15:13:05.681970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 188/384] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:05 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:05.864116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:05.864763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:05.870723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:05.871203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:05.871631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:05.872316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:05.872800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:05.873220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.003561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:06.011342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-61a54e7c-b0d9-4b78-834e-b612c76ea632 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.151622 Sep 19 15:13:06.011914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 197/385] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:06.704887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:06.705523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:06.711569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:06.712042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:06.712560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.713256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:06.713787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:06.714212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:06.847020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:06.854737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dbdab602-2544-47a0-a5ed-a69c4184379f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.153842 Sep 19 15:13:06.855300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 189/386] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:06 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:07.034940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:07.035331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:07.041195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.041679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.042116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.042808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.043260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.043682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.174425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:07.182149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2545d400-2138-4a61-806f-b24c71296ff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.151921 Sep 19 15:13:07.182715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 198/387] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:07.878900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:07.879436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:07.886037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.886522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.886956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:07.887645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:07.888124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:07.888570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:08.017844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:08.025483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6c84e1e4-eea1-47ac-aefa-0e0334a570a3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.151263 Sep 19 15:13:08.026070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 190/388] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:07 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:08.204876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:08.205383 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:08.211133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:08.211614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:08.212048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:08.212761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:08.213221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:08.213654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:08.341202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:08.349725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-819378a1-f511-4572-bd52-7d53d1a11559 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.148860 Sep 19 15:13:08.350296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 199/389] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:09.048161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:09.048745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:09.055133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:09.055617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:09.056056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:09.056781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:09.057240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:09.057664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:09.192114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:09.199797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe6701b1-18c6-4295-aa25-5cf2494629bc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.155611 Sep 19 15:13:09.200360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 191/390] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:09 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:09.372292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:09.372926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:09.379854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:09.380338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:09.380802 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:09.381489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:09.381942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:09.382364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:09.512632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:09.520307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8185f3ee-d74b-4fe4-8614-7438a9fa4065 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.151854 Sep 19 15:13:09.520901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 200/391] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:10.223763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:10.225250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:10.232036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:10.232572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:10.238902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:10.238902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:10.238902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:10.238902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:10.364445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:10.372189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-521d3e2d-4948-47f9-8fc1-c154e3777c28 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.153042 Sep 19 15:13:10.372791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 192/392] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:10 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:10.543225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:10.543772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:10.550632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:10.551114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:10.551546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:10.552238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:10.552727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:10.553149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:10.695095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:10.703892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aecb0d0e-c0aa-47d9-9c85-fb78152e6084 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.164638 Sep 19 15:13:10.704560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 201/393] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:11.394774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:11.395381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:11.402001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:11.402484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:11.402926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:11.403615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:11.404067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:11.404520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:11.537201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:11.545466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-69bde88f-289c-442b-bb0d-bbbea05060aa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.154677 Sep 19 15:13:11.546038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 193/394] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:11 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:11.727186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:11.728053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:11.734016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:11.734500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:11.734938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:11.735628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:11.736171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:11.736642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:11.873343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:11.881022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-47868f52-a938-4705-a0c9-d0554982dcca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.157701 Sep 19 15:13:11.881583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 202/395] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:12.569250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:12.569868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:12.576307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:12.576838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:12.577281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:12.577983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:12.578447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:12.578877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:12.709201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:12.716833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d0cd6245-c23a-4d38-94f3-81047654f5d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.151504 Sep 19 15:13:12.717398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 194/396] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:12 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:12.903178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:12.903804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:12.910345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:12.910816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:12.911279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:12.911954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:12.912401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:12.912843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:13.050631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:13.058225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-05734536-9e21-4c38-b2e8-99e6850289f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.158947 Sep 19 15:13:13.058775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 203/397] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:13.466636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-a704edab-e8de-4c22-9b8a-176afa7afa93 req-e1e27459-6236-4a42-8f52-ae92c2b5149b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31955ace-a21d-4a42-8e97-33da4bca71f0", "name": "network-vif-plugged", "status": "completed", "tag": "a7905d0d-ddbc-4310-b98e-9d7db60cfd0d"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:13.476928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a704edab-e8de-4c22-9b8a-176afa7afa93 req-e1e27459-6236-4a42-8f52-ae92c2b5149b service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:13.479936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a704edab-e8de-4c22-9b8a-176afa7afa93 req-e1e27459-6236-4a42-8f52-ae92c2b5149b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:13.479936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a704edab-e8de-4c22-9b8a-176afa7afa93 req-e1e27459-6236-4a42-8f52-ae92c2b5149b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:13.494406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-a704edab-e8de-4c22-9b8a-176afa7afa93 req-e1e27459-6236-4a42-8f52-ae92c2b5149b service nova] Creating event network-vif-plugged:a7905d0d-ddbc-4310-b98e-9d7db60cfd0d for instance 31955ace-a21d-4a42-8e97-33da4bca71f0 on hv-cinder-75671 Sep 19 15:13:13.502481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-a704edab-e8de-4c22-9b8a-176afa7afa93 req-e1e27459-6236-4a42-8f52-ae92c2b5149b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038780 Sep 19 15:13:13.503184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 195/398] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:13.740833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:13.741450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:13.747699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:13.748189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:13.748666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:13.749359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:13.749817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:13.750242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:13.886903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:13.894596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f94b1ccd-c999-403a-810e-ebba42dd9087 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.157748 Sep 19 15:13:13.895154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 204/399] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:13 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:14.082121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:14.082814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:14.088815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:14.089288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:14.093549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:14.093549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:14.093549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:14.093549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:14.236007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:14.244112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-61c31da1-a8fd-4b1f-8dae-046650076856 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.167371 Sep 19 15:13:14.244702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 196/400] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:14.917453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:14.918074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:14.924713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:14.925216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:14.925685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:14.926379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:14.926834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:14.927262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:15.060660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:15.068627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1e7e00de-51ce-460e-b320-48b469f7c911 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.155035 Sep 19 15:13:15.069188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 205/401] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:14 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:15.267832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:15.269186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:15.276288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:15.278672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:15.278672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:15.278672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:15.278672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:15.279449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:15.463147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:15.471218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7c160959-fdf7-4310-9588-11ef8ce0b410 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.207394 Sep 19 15:13:15.471782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 197/402] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:16.091712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:16.092345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:16.099243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:16.099722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:16.100148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:16.100857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:16.101305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:16.101720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:16.242502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:16.250436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cf09da58-5a4e-4dd0-9291-e62ec5dcdc20 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.162717 Sep 19 15:13:16.255491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 206/403] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:16 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:16.366910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:16.369472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:16.373960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:16.374446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:16.374888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:16.375586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:16.376048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:16.376504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:16.495287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:16.495903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:16.501916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:16.502482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:16.502933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:16.503632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:16.504310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:16.504759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:16.505376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid 9575666b-2db2-40f8-81d8-b08d2a086cce {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:16.640940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:16.649736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b9b7d5ba-7c0e-4e80-a390-9331758b5efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.158431 Sep 19 15:13:16.650313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 207/404] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:16.723968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e8ed0432-68e1-4654-9286-e83e9228293d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce/os-volume_attachments/ef7e01c2-1f2a-4272-a7b7-0168d1b2baff" status: 202 len: 0 microversion: 2.1 time: 0.360929 Sep 19 15:13:16.724579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 198/405] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:13:16 2022] DELETE /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce/os-volume_attachments/ef7e01c2-1f2a-4272-a7b7-0168d1b2baff => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:13:17.274125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:17.274736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:17.280759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.281247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.281685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.282553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.283364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.283884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.415382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:17.424630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e6f08424-c921-40fc-809e-92b7cc802b03 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.154364 Sep 19 15:13:17.425301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 208/406] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:17 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:17.672947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:17.673869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:17.680541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.681032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.681466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.682173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:17.682633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:17.683060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:17.788870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-740535978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2133944848", "security_groups": [{"name": "tempest-secgroup-smoke-1283070169"}], "block_device_mapping_v2": [{"uuid": "54a586e4-eed8-4e82-9223-685acb773fd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e9db59a0-d876-403f-9298-cf2d31bb4ecb"}]}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:17.826734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:17.835100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3ad38725-d228-436e-afa7-28341bc55697 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1258 microversion: 2.1 time: 0.166381 Sep 19 15:13:17.835904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 199/407] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:17.917442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] validate_networks() for [('e9db59a0-d876-403f-9298-cf2d31bb4ecb', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:13:18.294077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:13:18.294695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:13:18.294957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:13:18.295365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:13:18.295772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:13:18.305457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.305939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.306374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:18.307100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.307554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.307981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:18.324319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Getting quotas for project 44cfaa7a9ec843e1a26460270f99a9e2. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:18.328325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Getting quotas for user c0121ba668034aac98863a2caf80320e and project 44cfaa7a9ec843e1a26460270f99a9e2. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:18.386560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:13:18.388782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54a586e4-eed8-4e82-9223-685acb773fd7',volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:13:18.447306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:18.447922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:18.453916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.454398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.455576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:18.456519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.456985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.457412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:18.587820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:18.595765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-55376a3a-2a6a-4bd0-87e7-2d1fe4638d2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1521 microversion: 2.1 time: 0.152184 Sep 19 15:13:18.596707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 200/408] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:18 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:18.788140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-60916897-5188-48f6-91ea-3dfa2a6197db tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.003287 Sep 19 15:13:18.794967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 209/409] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:13:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:13:18.801283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9f2bdaa2-db72-48b9-b58a-efb4f6e6175d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:18.801916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9f2bdaa2-db72-48b9-b58a-efb4f6e6175d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:18.858933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:18.859553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:18.860132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9f2bdaa2-db72-48b9-b58a-efb4f6e6175d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:18.868804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.868983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.869606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:18.870441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9f2bdaa2-db72-48b9-b58a-efb4f6e6175d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1094 microversion: 2.1 time: 0.074172 Sep 19 15:13:18.870694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:18.871302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:18.871415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 201/410] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:18 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:18.872297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.024805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:19.032706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a5dd0b8-2069-4d30-aa0a-38a660e2d6a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1442 microversion: 2.1 time: 0.178030 Sep 19 15:13:19.034242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 210/411] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1442 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:19.066135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:19.066739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:19.073240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.073723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.074156 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.074841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.075294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.075713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.219278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:19.227048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3c6f98c7-e3a2-452b-9723-3b9a6ce78d78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1442 microversion: 2.1 time: 0.164991 Sep 19 15:13:19.227877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 202/412] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:19.620036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:19.620801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:19.629020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.629550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.633656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.633656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.633656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.633656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.857108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:19.866172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8cf64a30-5d17-4262-9e02-8b795668ec61 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1501 microversion: 2.1 time: 0.249967 Sep 19 15:13:19.866747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 211/413] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:19 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:19.891421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:19.892910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:19.895837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-035ad059-28f9-4811-89cd-f7e9c15abf61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:19.896706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-035ad059-28f9-4811-89cd-f7e9c15abf61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:19.901769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.902354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.902785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.906857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:19.906857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:19.906857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:19.975670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-035ad059-28f9-4811-89cd-f7e9c15abf61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:19.983430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-035ad059-28f9-4811-89cd-f7e9c15abf61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1094 microversion: 2.1 time: 0.092253 Sep 19 15:13:19.984150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 212/414] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:19 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:20.113034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:20.120831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-121e9372-3ee0-4e44-9c32-8261f6220314 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1516 microversion: 2.1 time: 0.233860 Sep 19 15:13:20.121388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 203/415] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:19 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1516 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:21.007588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:21.008207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:21.021944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.022399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.022838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.023547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.024005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.024429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.101094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:21.101689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:21.112946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.116966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.116966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.116966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.116966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.117381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.148363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:13:21.152136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:21.262700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:21.271424 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9f05cdb0-a03d-4a77-b284-d6bc4464a7ae tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1192 microversion: 2.1 time: 0.267644 Sep 19 15:13:21.272185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 213/416] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:21 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1192 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:21.430183 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-026f5420-f199-4c73-9f3c-c0e98c9f8a24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 204 len: 0 microversion: 2.1 time: 0.332245 Sep 19 15:13:21.430706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 204/417] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:13:21 2022] DELETE /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:13:21.439339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:21.441996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:21.446527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.447010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.447437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.448193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:21.448672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:21.449101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:21.453122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:21.879279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:21.887359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d2c87a32-b469-45f4-bd7d-d59870453fcb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1514 microversion: 2.1 time: 0.452025 Sep 19 15:13:21.888066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 214/418] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:21 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1514 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:21.992912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-d5913985-838a-48e3-98dd-7fa58c45de10 req-a569a2a9-3b46-4619-a9c2-d10b1c03369f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31955ace-a21d-4a42-8e97-33da4bca71f0", "tag": "a7905d0d-ddbc-4310-b98e-9d7db60cfd0d"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:22.002746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-d5913985-838a-48e3-98dd-7fa58c45de10 req-a569a2a9-3b46-4619-a9c2-d10b1c03369f service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.003229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-d5913985-838a-48e3-98dd-7fa58c45de10 req-a569a2a9-3b46-4619-a9c2-d10b1c03369f service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.003661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-d5913985-838a-48e3-98dd-7fa58c45de10 req-a569a2a9-3b46-4619-a9c2-d10b1c03369f service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.014653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-d5913985-838a-48e3-98dd-7fa58c45de10 req-a569a2a9-3b46-4619-a9c2-d10b1c03369f service nova] Creating event network-changed:a7905d0d-ddbc-4310-b98e-9d7db60cfd0d for instance 31955ace-a21d-4a42-8e97-33da4bca71f0 on hv-cinder-75671 Sep 19 15:13:22.019741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-d5913985-838a-48e3-98dd-7fa58c45de10 req-a569a2a9-3b46-4619-a9c2-d10b1c03369f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030850 Sep 19 15:13:22.020328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 205/419] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:22.295542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:22.296133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:22.302880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.303370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.303806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.304533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.304994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.305422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.372339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:22.380684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c8524125-dd1f-421a-85ff-afa721ebca1e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1200 microversion: 2.1 time: 0.088965 Sep 19 15:13:22.381483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 215/420] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:22 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:22.913495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:22.914337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:22.920744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.922623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.922623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:22.922623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:22.922972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:22.923445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.002432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:23.004806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:23.015790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.015790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.015790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.015790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.016175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.016175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.038780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lazy-loading 'flavor' on Instance uuid ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:23.066772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:23.076300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-408b20f9-805e-4972-9f08-ca45c54a578e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1514 microversion: 2.1 time: 0.168393 Sep 19 15:13:23.077310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 206/421] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:22 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:23.386486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-71c3a504-b7ea-4dfc-bd4f-4626f0500bd3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/action" status: 200 len: 32 microversion: 2.1 time: 0.388389 Sep 19 15:13:23.390759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 216/422] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:22 2022] POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 15:13:23.400232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:23.401118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:23.407750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.408655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.409251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.410122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.410593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.411029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.417160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:23.417886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:23.426395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.427135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.427762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.428673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:23.429839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:23.430442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:23.565594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:23.573671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c5e825e3-31a1-41e8-8eef-ac43fddcfd6f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1200 microversion: 2.1 time: 0.172689 Sep 19 15:13:23.581230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 217/423] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:23 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1200 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:23.692271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:23.700406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-996b38eb-f438-4787-8d04-4f7d99b4e16f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.306029 Sep 19 15:13:23.701017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 207/424] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:23 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:24.102460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:24.103334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:24.110708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.111304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.111915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.112810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.113262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.113677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.398933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:24.417264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-83483df2-63d2-4200-af6a-0304c7addcce tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1514 microversion: 2.1 time: 0.316933 Sep 19 15:13:24.417264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 218/425] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:24 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:24.598960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:24.599575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:24.607925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.607925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.608738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.609481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.609940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.610577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.725198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:24.726115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:24.737520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.740460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.740460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.740460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:24.740460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:24.740828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:24.867148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:24.875756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-120a33f6-1fb2-4dd0-b8f8-82fee43028ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1278 microversion: 2.1 time: 0.282192 Sep 19 15:13:24.876337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 208/426] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:24 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:25.017886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-fb5ddce6-b779-4b07-9f53-c0b222c327b3 req-f0e4e266-c5ae-480e-8d77-f651d8bb899c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575666b-2db2-40f8-81d8-b08d2a086cce", "name": "network-vif-deleted", "tag": "ff4471ce-9801-48a7-9ddd-95ba6abe2556"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:25.028378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-fb5ddce6-b779-4b07-9f53-c0b222c327b3 req-f0e4e266-c5ae-480e-8d77-f651d8bb899c service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:25.028947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-fb5ddce6-b779-4b07-9f53-c0b222c327b3 req-f0e4e266-c5ae-480e-8d77-f651d8bb899c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:25.029436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-fb5ddce6-b779-4b07-9f53-c0b222c327b3 req-f0e4e266-c5ae-480e-8d77-f651d8bb899c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:25.041555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-fb5ddce6-b779-4b07-9f53-c0b222c327b3 req-f0e4e266-c5ae-480e-8d77-f651d8bb899c service nova] Creating event network-vif-deleted:ff4471ce-9801-48a7-9ddd-95ba6abe2556 for instance 9575666b-2db2-40f8-81d8-b08d2a086cce on hv-cinder-75671 Sep 19 15:13:25.046741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-fb5ddce6-b779-4b07-9f53-c0b222c327b3 req-f0e4e266-c5ae-480e-8d77-f651d8bb899c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033040 Sep 19 15:13:25.047450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 209/427] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:13:25.078080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:25.090603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-589054a3-fdaf-4524-bc76-cd08c9fb82e4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.370544 Sep 19 15:13:25.091381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 219/428] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:24 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:25.440316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:25.441092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:25.443039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:25.448004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:25.448500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:25.448981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:25.449687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:25.450196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:25.450628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:25.563060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:25.572843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-61082488-789f-4aae-ad53-5de3f2f4cf85 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1304 microversion: 2.1 time: 0.137158 Sep 19 15:13:25.573766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 210/429] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:25 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:25.901096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:25.905398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:25.905398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:25.910657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:25.911153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:25.911597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:25.912305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:25.912847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:25.913276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.049843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:26.057498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-df99ff73-74f0-4b6b-b12b-816d126dd442 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.160455 Sep 19 15:13:26.058056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 220/430] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:25 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:26.115372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:26.115980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:26.122355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.122832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.123264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.123949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.124399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.124852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.253118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:26.261083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b7ea1103-2546-47d3-a8b1-d3a458c65030 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.150038 Sep 19 15:13:26.261661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 211/431] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:26 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:26.597478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:26.598096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:26.604277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.604797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.605250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.605931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.606390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.606813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.636625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:26.637102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:26.637536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:26.637981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'fault' on Instance uuid 9575666b-2db2-40f8-81d8-b08d2a086cce {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:26.681709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:26.689190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8414aa18-2c15-4fb7-843c-8db06671ed24 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1309 microversion: 2.1 time: 0.096406 Sep 19 15:13:26.689753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 221/432] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:26 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:27.070899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-7f65c4b0-431e-40a5-8fc7-2cb8782261ff req-0871250b-461c-4b5a-ae9f-d39f5b9725da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609cf815-b2a9-4258-82a9-29d7eded8012", "tag": "ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:27.081350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-7f65c4b0-431e-40a5-8fc7-2cb8782261ff req-0871250b-461c-4b5a-ae9f-d39f5b9725da service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.081616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:27.082155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-7f65c4b0-431e-40a5-8fc7-2cb8782261ff req-0871250b-461c-4b5a-ae9f-d39f5b9725da service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.082245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:27.082336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-7f65c4b0-431e-40a5-8fc7-2cb8782261ff req-0871250b-461c-4b5a-ae9f-d39f5b9725da service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.088073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.088591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.089040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.089746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.090204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.090632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.093748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-7f65c4b0-431e-40a5-8fc7-2cb8782261ff req-0871250b-461c-4b5a-ae9f-d39f5b9725da service nova] Creating event network-changed:ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c for instance 609cf815-b2a9-4258-82a9-29d7eded8012 on hv-cinder-75671 Sep 19 15:13:27.099089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-7f65c4b0-431e-40a5-8fc7-2cb8782261ff req-0871250b-461c-4b5a-ae9f-d39f5b9725da service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031728 Sep 19 15:13:27.099709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 212/433] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:27.222412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:27.230272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-789d287f-2721-4898-96b2-4aab19e877d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.153164 Sep 19 15:13:27.230828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 222/434] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:27 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:27.283967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:27.284681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:27.290709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.291190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.291618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.292300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.292770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.293190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.421503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:27.429775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6f7a7ee1-66fe-431b-bc76-bad41ecac836 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.150415 Sep 19 15:13:27.434319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 213/435] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:27 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:27.712112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:27.712678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:27.718570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.719052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.719490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.720179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.720774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.721357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.753881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:27.754362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:27.754797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:27.755243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'fault' on Instance uuid 9575666b-2db2-40f8-81d8-b08d2a086cce {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:27.801138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:27.808872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-553e36e2-baaa-4b31-bfa3-18a5b5b3200e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1309 microversion: 2.1 time: 0.100723 Sep 19 15:13:27.809437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 223/436] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:27 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:28.253681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:28.254296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:28.260323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.260842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.261283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.261977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.262436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.262937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.394536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:28.402178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7f0dd00d-432a-4812-9167-2818bef8cb98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.153293 Sep 19 15:13:28.402747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 214/437] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:28 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:28.453490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:28.454100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:28.456819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:28.461624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.462110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.462551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.463283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.463741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.464164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.593676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:28.601555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-22f01092-49bb-4f19-8aad-957a95b7e475 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.151964 Sep 19 15:13:28.602483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 224/438] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:28 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:28.832560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:28.833177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:28.839245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.839729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.840167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.840899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.841403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.841776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.871932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:28.875454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:28.875935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:28.876374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:28.877443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'fault' on Instance uuid 9575666b-2db2-40f8-81d8-b08d2a086cce {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:28.924454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:28.932218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-860305dc-be5f-49e2-9ef0-477d3d59bb00 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1309 microversion: 2.1 time: 0.103808 Sep 19 15:13:28.932816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 215/439] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:28 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:29.425750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:29.426365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:29.433301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.434347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.434347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.434896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.435361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.435787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.611534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:29.620215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9646e905-8762-4851-814c-3a4322f4b34c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.198166 Sep 19 15:13:29.620215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 225/440] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:29 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:29.625804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:29.626180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:29.638249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.638745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.639185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.639904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.640361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.640831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.874821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:29.885166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cfbcbaa2-8f86-45f1-8bf2-36daa4a1ef0c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.263477 Sep 19 15:13:29.891441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 216/441] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:29 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:29.955389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:29.955997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:29.962351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.962841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.963307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.964072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:29.964552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:29.965880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:29.981841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=8 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:29.999236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.000060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.000211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.000668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'fault' on Instance uuid 9575666b-2db2-40f8-81d8-b08d2a086cce {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:13:30.047342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:30.055536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-33ff8fad-2172-4423-b7a3-0a6f93ea699d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 200 len: 1309 microversion: 2.1 time: 0.104043 Sep 19 15:13:30.056109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 226/442] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:29 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:30.643206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:30.644013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:30.650505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.650982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.651414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.652100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.652578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.652997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.805620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:30.812757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4568d824-fd42-444d-aef5-c6a8c5c406c3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.174304 Sep 19 15:13:30.813318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 217/443] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:30 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:30.908853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:30.909415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:30.915295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.915782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.916224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:30.916937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:30.917399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:30.917828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.051790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:31.054019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:31.060656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bda8089f-f205-451c-aca1-2b503ff566c2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.156149 Sep 19 15:13:31.061468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 227/444] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:30 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:31.078513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:31.081420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: 9575666b-2db2-40f8-81d8-b08d2a086cce] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:31.085052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.085537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.085976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.086669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.087126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.087558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.101879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Instance 9575666b-2db2-40f8-81d8-b08d2a086cce could not be found. Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce HTTP/1.1 Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:13:31.103802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 9575666b-2db2-40f8-81d8-b08d2a086cce could not be found. Sep 19 15:13:31.105480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '9575666b-2db2-40f8-81d8-b08d2a086cce'} Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9575666b-2db2-40f8-81d8-b08d2a086cce could not be found. Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:13:31.106287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9575666b-2db2-40f8-81d8-b08d2a086cce could not be found. Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9575666b-2db2-40f8-81d8-b08d2a086cce could not be found. Sep 19 15:13:31.107493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:31.108596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 404 to user: Instance 9575666b-2db2-40f8-81d8-b08d2a086cce could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:13:31.108596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bc662ba8-cb28-424d-a077-cab6743689c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce" status: 404 len: 111 microversion: 2.1 time: 0.030659 Sep 19 15:13:31.108596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 218/445] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:31 2022] GET /compute/v2.1/servers/9575666b-2db2-40f8-81d8-b08d2a086cce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:13:31.836313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:31.836979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:31.843473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.843955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.844387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.845100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:31.846377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:31.846793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:31.980562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:31.988599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e9ad6d7d-749c-431e-9c31-021362109de2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.156433 Sep 19 15:13:31.989167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 228/446] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:31 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:32.084311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:32.084950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:32.091382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.091857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.092289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.092993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:32.093442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:32.093862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:32.222010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:32.230013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4e5030e9-179a-4e70-a179-c415f1077b1c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.150186 Sep 19 15:13:32.230571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 219/447] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:32 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:33.011317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:33.011926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:33.018079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.018564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.018999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.019689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.020147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.020609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.155593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:33.163863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-36fdde3f-ad66-4660-8916-e0f11097c965 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.156573 Sep 19 15:13:33.164429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 229/448] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:33 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:33.253358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:33.253967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:33.260500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.260990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.261423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.262114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:33.262574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:33.262994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:33.390192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:33.397912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cfe2af71-da3f-474d-8b2f-df5b861bcd1e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.148899 Sep 19 15:13:33.398470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 220/449] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:33 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:34.187016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:34.187610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:34.193827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.194319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.194732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.195413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.195861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.196278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.322869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:34.331256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-61721371-3244-4a38-942d-377fda1fc1d3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.148105 Sep 19 15:13:34.331823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 230/450] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:34 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:34.420595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:34.421207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:34.427665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.428172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.428629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.429344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:34.429792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:34.430210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:34.576694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:34.585356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-31cf8e98-0b66-4b1a-b24a-401911146727 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.168622 Sep 19 15:13:34.585929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 221/451] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:34 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:35.355010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:35.355661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:35.362237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:35.362756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:35.363197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:35.363883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:35.364340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:35.364795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:35.495323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:35.503652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b43a78b6-b373-4c2f-b148-7d65d7143a0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.152850 Sep 19 15:13:35.504215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 231/452] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:35 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:35.608118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:35.608700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:35.615367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:35.615847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:35.616277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:35.617017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:35.617473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:35.617895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:35.621748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:35.752515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:35.760433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b6662ad-9c9e-40d7-aea8-b3876f410c23 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.156077 Sep 19 15:13:35.761095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 222/453] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:35 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:36.526392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:36.527006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:36.532958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.533560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.534102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.534806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.535266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.535706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.668036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:36.676300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c34e98de-338f-4659-9325-83aeb6f48b2f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.153900 Sep 19 15:13:36.676887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 232/454] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:36 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:36.789323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:36.789936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:36.796530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.797017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.797459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.798157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:36.798615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:36.799079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:36.929497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:36.937058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-82fa7a92-5776-44d2-a848-75242ff88ebb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.151583 Sep 19 15:13:36.937614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 223/455] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:36 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:37.698617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:37.699229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:37.705176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:37.706246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.706872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:37.707564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:37.708023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.708447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:37.837435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:37.845120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7bf00e1f-97a5-42a6-8087-74d170e5aaf5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.150378 Sep 19 15:13:37.845678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 233/456] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:37 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:37.959188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:37.959909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:37.966304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:37.966789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.967222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:37.967913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:37.968364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:37.968817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.098068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:38.106019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-46b2d466-2a19-4c83-a625-eb5eee05612a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.150957 Sep 19 15:13:38.106580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 224/457] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:37 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:38.868511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:38.869104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:38.875054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.875530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.875960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:38.876697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:38.877150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:38.877972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:39.010628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:39.018872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e9c1aea2-5b19-4191-8e28-63b799f8278f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.153749 Sep 19 15:13:39.019537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 234/458] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:38 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:39.129424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:39.130027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:39.136443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:39.136946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:39.137370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:39.138051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:39.138496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:39.139023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:39.269237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:39.276769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bf924d8f-aa07-4b12-9fcd-fe1aa27d897d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.151672 Sep 19 15:13:39.277325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 225/459] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:39 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:40.041469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:40.042073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:40.048036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.048532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.048965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.050348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.050801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.051222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.185134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:40.192741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-87e20742-ba98-4ebf-84c0-12ebef297b95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.155055 Sep 19 15:13:40.193302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 235/460] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:40 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:40.299103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:40.299718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:40.306170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.306802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.307193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.307896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:40.308345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:40.308795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:40.439585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:40.446890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-090b44c3-1243-44ec-a69f-32f81d43a70d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.151716 Sep 19 15:13:40.447462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 226/461] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:40 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:41.215509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:41.216142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:41.222329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:41.222811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:41.223407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.224090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:41.224565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:41.224986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.356521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:41.364472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-181c91d2-12bf-4d40-9fe0-3b04624c612f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.152815 Sep 19 15:13:41.365047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 236/462] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:41 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:41.470283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:41.471015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:41.477899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:41.478656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:41.479104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.479886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:41.480350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:41.480821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:41.854910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:41.863634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c3f62f13-a5fe-4a13-bac2-3e55a90d938c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.396987 Sep 19 15:13:41.864204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 227/463] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:41 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:42.387531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:42.388137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:42.394378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.394901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.395336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.396029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.396530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.396935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.532121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:42.540632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6ac9b788-1954-4800-b470-da452abf2050 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.157156 Sep 19 15:13:42.541222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 237/464] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:42 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:42.887552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:42.888159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:42.894978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.895462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.895904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:42.896634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:42.897095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:42.897523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.041608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:43.050040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-de0b81bc-639e-4b05-8933-7f720cc5da47 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.165736 Sep 19 15:13:43.050622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 228/465] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:42 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:43.564018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:43.564682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:43.570675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:43.571168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:43.571605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.572306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:43.572796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:43.573224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:43.707218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:43.716619 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-033509d9-8aae-4b6f-a0d7-208db9ce7e62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.156509 Sep 19 15:13:43.717258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 238/466] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:43 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:44.073187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:44.073802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:44.081155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.081661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.082100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.082813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.083269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.083720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.227712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:44.235923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4092e523-d08e-4a83-9b38-82cdebdb503d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.166621 Sep 19 15:13:44.236524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 229/467] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:44 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:44.742517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:44.743062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:44.749133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.749608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.750038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.750726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:44.751176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:44.751593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:44.885188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:44.892835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-042973d7-84be-4484-98f5-9b730836e1ab tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.154219 Sep 19 15:13:44.893937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 239/468] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:44 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:45.259687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:45.260571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:45.266643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:45.267126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:45.267564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:45.268883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:45.269482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:45.269923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:45.400470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:45.408104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e8ce47e2-fe14-491b-a055-e2c2e5c4f280 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.152404 Sep 19 15:13:45.408686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 230/469] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:45 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:45.915983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:45.916660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:45.922843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:45.923381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:45.923816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:45.925160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:45.925680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:45.926108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:46.059482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:46.067243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f39021aa-76b4-43d2-aa59-d825e15daaf0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.155332 Sep 19 15:13:46.067798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 240/470] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:45 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:46.431383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:46.431991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:46.438540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:46.439016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:46.439447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:46.441017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:46.441509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:46.441934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:46.571032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:46.578840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4d69cb18-1089-4bd1-b8e9-51c0a12ab924 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.151463 Sep 19 15:13:46.579501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 231/471] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:46 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:47.094723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:47.095342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:47.101553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:47.102038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:47.102478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.103798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:47.104660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:47.105438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.247313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:47.254975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-201c66be-0d63-4a28-9e78-eb43121b75d4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.164143 Sep 19 15:13:47.255541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 241/472] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:47 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:47.603173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:47.604190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:47.610708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:47.611188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:47.611626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.612369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:47.612898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:47.613325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:47.739947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:47.748160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe120ff4-991e-442f-8189-9ba67d00d4b6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.148828 Sep 19 15:13:47.748777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 232/473] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:47 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:48.277312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:48.277856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:48.283727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:48.284855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:48.285290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:48.285965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:48.286415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:48.286828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:48.419568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:48.427863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7b023463-65cd-441c-a371-cdbd21f67f01 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.154425 Sep 19 15:13:48.428425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 242/474] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:48 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:48.771502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:48.772131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:48.778933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:48.779123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:48.779556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:48.780251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:48.780738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:48.781185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:48.915387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:48.922965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1b8910fc-dab6-433f-8948-e65fdbd4b96e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.155775 Sep 19 15:13:48.923513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 233/475] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:48 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:49.451010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:49.451639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:49.458420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:49.459136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:49.459582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:49.460278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:49.460762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:49.461206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:49.738287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:49.747703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-85b2e345-bd65-4b1a-a10d-7c226cc27f67 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.300319 Sep 19 15:13:49.748431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 243/476] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:49 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:49.861676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-978786946", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "networks": [{"uuid": "3b6bc144-d32e-4406-a24a-376de1fd8c0e"}]}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:49.861676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] validate_networks() for [('3b6bc144-d32e-4406-a24a-376de1fd8c0e', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:13:49.946190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:49.946876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:49.953031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:49.953597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:49.954103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:49.955215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:49.955499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:49.956121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:49.975804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:50.177561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:50.185168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-74fc4ae4-3ce4-48b3-b036-883073901f2c tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.242863 Sep 19 15:13:50.185741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 244/477] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:49 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:50.291591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:13:50.292014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:13:50.292514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:13:50.292927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:13:50.293371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:13:50.302892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:50.303406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:50.303842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:50.304612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:50.305074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:50.305497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:50.322391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Getting quotas for project f1bbde55bafa42108676212642d7d3bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:13:50.326335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Getting quotas for user 0b4ee04a6c6d42fd9bc97d5e356d4a0a and project f1bbde55bafa42108676212642d7d3bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:13:50.337755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:13:50.340031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:13:50.437892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cc389546-facd-4c07-892a-70a3611fd26a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640865 Sep 19 15:13:50.438509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 234/478] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:13:50.450263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fea08a2e-531e-493d-9542-a78ca817ef6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:50.450864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fea08a2e-531e-493d-9542-a78ca817ef6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:50.505093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fea08a2e-531e-493d-9542-a78ca817ef6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:50.512154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fea08a2e-531e-493d-9542-a78ca817ef6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1218 microversion: 2.1 time: 0.065731 Sep 19 15:13:50.512758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 245/479] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:50 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:50.778130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:50.778750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:50.785751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:50.786206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:50.786656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:50.787359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:50.787825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:50.788254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:50.925639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:50.933496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-32cd995b-6fa9-42af-905c-be16f86b2960 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.159343 Sep 19 15:13:50.934240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 235/480] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:50 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:51.207344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:51.207985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:51.213929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:51.214415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:51.214856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:51.215545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:51.215998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:51.216425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:51.351412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:51.359513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-23ad84b3-eefe-4cc2-b393-080029fc9874 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.156210 Sep 19 15:13:51.360080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 246/481] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:51 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:51.535564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:51.536218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:51.542227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:51.542738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:51.543178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:51.543873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:51.544331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:51.544790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:51.607881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:51.616267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9fae562b-2850-4128-9c15-0ff29d7136ad tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1222 microversion: 2.1 time: 0.085122 Sep 19 15:13:51.616857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 236/482] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:51 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:51.957384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:51.958039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:51.966390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:51.966874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:51.967311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:51.968010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:51.968468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:51.968918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:52.120040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:52.129412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b955f6c5-6fd6-4381-8bc2-83d08159d953 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.175869 Sep 19 15:13:52.130416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 247/483] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:51 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:52.384197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:52.384860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:52.391592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:52.393487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:52.395390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:52.396274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:52.396774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:52.397211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:52.546792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:52.556511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-30883218-910b-4ef3-b384-433df4f91ee2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.176156 Sep 19 15:13:52.557089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 237/484] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:52 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:52.639149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:52.639678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:52.645751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:52.646235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:52.646667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:52.647349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:52.647801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:52.648222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:52.708401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:52.715918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d0de26e5-4273-4571-8ea9-2963a6f8432f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1222 microversion: 2.1 time: 0.080746 Sep 19 15:13:52.716471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 248/485] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:52 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:53.153325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:53.153932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:53.159808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:53.160839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:53.161265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:53.161947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:53.162394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:53.162809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:53.294293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:53.298730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8523f968-19ca-48b9-a327-e83f80e3356f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.149164 Sep 19 15:13:53.299318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 238/486] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:53 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:53.585454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:53.586054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:53.591911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:53.592411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:53.592851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:53.593528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:53.593973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:53.594388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:53.727940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:53.735892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e941d821-278d-4528-81ea-7d4fb75f9c18 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.154905 Sep 19 15:13:53.736451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 249/487] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:53 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:53.738450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:53.739059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:53.745369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:53.745848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:53.746280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:53.746965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:53.747413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:53.747831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:53.763142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:53.809314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:53.817563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fdd0383b-2e94-40bc-a263-6ff11a3190ac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1222 microversion: 2.1 time: 0.082863 Sep 19 15:13:53.818125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 239/488] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:54.323066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:54.323669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:54.329609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:54.330080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:54.330508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:54.331181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:54.331626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:54.332144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:54.466441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:54.474718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0713a02d-a535-4c6f-add1-9f26ffa333fa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.155970 Sep 19 15:13:54.475269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 250/489] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:54 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:54.759272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:54.759860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:54.765682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:54.766159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:54.766589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:54.767269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:54.767717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:54.768135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:54.840239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:54.840859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:54.846734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:54.847216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:54.847688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:54.848734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:54.849559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:54.850732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:54.908928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:54.916760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f6209f2c-b8ec-4b40-a3c6-08e07036b852 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.162751 Sep 19 15:13:54.917333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 240/490] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:54 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:54.924115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:54.932610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2ef1de77-5e79-4c6f-b74b-4a02544d919f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1222 microversion: 2.1 time: 0.096194 Sep 19 15:13:54.933169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 251/491] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:55.498552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:55.499162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:55.506337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.506927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.507355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:55.508045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.508577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.509040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:55.639170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:55.648985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9229f3e0-0f2a-427d-b4de-985e31b3cb69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.154420 Sep 19 15:13:55.649783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 241/492] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:55 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:55.706173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-d8a400c7-ff83-422e-b0a6-00aff82526c4 req-e8b8e828-f28b-42b6-8a6c-fd6854276f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609cf815-b2a9-4258-82a9-29d7eded8012", "name": "network-vif-plugged", "status": "completed", "tag": "ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:55.717421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d8a400c7-ff83-422e-b0a6-00aff82526c4 req-e8b8e828-f28b-42b6-8a6c-fd6854276f41 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.720434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d8a400c7-ff83-422e-b0a6-00aff82526c4 req-e8b8e828-f28b-42b6-8a6c-fd6854276f41 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.720434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d8a400c7-ff83-422e-b0a6-00aff82526c4 req-e8b8e828-f28b-42b6-8a6c-fd6854276f41 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:55.730304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-d8a400c7-ff83-422e-b0a6-00aff82526c4 req-e8b8e828-f28b-42b6-8a6c-fd6854276f41 service nova] Creating event network-vif-plugged:ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c for instance 609cf815-b2a9-4258-82a9-29d7eded8012 on hv-cinder-75671 Sep 19 15:13:55.735240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-d8a400c7-ff83-422e-b0a6-00aff82526c4 req-e8b8e828-f28b-42b6-8a6c-fd6854276f41 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 Sep 19 15:13:55.735765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 252/493] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:13:55.940239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:55.940920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:55.943817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:55.948514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.949009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.949549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:55.950187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.950647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.951076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:55.955862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:55.956614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:55.963656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.964179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.964661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:55.965486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:55.965961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:55.966379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:56.062013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:56.071252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0899fcbb-dfee-443d-9f09-88f07b8e0935 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1214 microversion: 2.1 time: 0.119706 Sep 19 15:13:56.071827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 253/494] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:55 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:56.123406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:56.131946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c95fd8eb-6ea9-4099-b6a0-8f7b3df576e6 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.195533 Sep 19 15:13:56.132613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 242/495] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:55 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:56.672076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:56.672667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:56.674677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=76 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:13:56.679371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:56.679846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:56.680281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:56.681058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:56.681513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:56.681935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:56.829049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:56.837589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-89af6227-5a22-4f5b-95e7-d89e67870aee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.169397 Sep 19 15:13:56.840505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 254/496] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:56 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:57.094868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:57.095474 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:57.101987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.102460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.102921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.103602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.104314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.104762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.155057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:57.155656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:57.161643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.162112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.162541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.163221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.163673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.164090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.167298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:57.174891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-88cad526-2e46-4448-b1e5-d8ac23bbe3f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1270 microversion: 2.1 time: 0.083874 Sep 19 15:13:57.175455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 243/497] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:57 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:57.290703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:57.298254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-964b9e73-ac94-467b-a5a4-cd6c5854b1b4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1502 microversion: 2.1 time: 0.147003 Sep 19 15:13:57.298810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 255/498] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:57 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:13:57.322838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6a682b7-d178-4a07-a845-594cf9849d03"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:57.325304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:57.331452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.331931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.332752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.333531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.333983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.334404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.357861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Cannot 'attach_volume' instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 while it is in vm_state rescued Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/os-volume_attachments HTTP/1.1 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 74 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:13:57.359677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {"volumeAttachment": {"volumeId": "f6a682b7-d178-4a07-a845-594cf9849d03"}} Sep 19 15:13:57.361261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Cannot 'attach_volume' instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 while it is in vm_state rescued Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'ee0ce04e-f5c6-42b8-bbac-8ab27d3df274', 'body': {'volumeAttachment': {'volumeId': 'f6a682b7-d178-4a07-a845-594cf9849d03'}}} Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:13:57.362286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 while it is in vm_state rescued Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:13:57.364304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 while it is in vm_state rescued Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 409 to user: Cannot 'attach_volume' instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 while it is in vm_state rescued {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b375c988-40b1-4604-beca-be19e411a258 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043249 Sep 19 15:13:57.365847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 244/499] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:13:57 2022] POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 19 15:13:57.375551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:13:57.376079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:57.382330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.382811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.383240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.383992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.384362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.384805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.649423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-99c7d698-d104-49bd-b64a-803083685575 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/action" status: 202 len: 0 microversion: 2.1 time: 0.277519 Sep 19 15:13:57.649977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 256/500] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:13:57 2022] POST /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:13:57.658078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:57.658684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:57.665116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.665613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.666056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.666757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.667215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.667642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.801609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:57.809888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2db18e2a-12ee-45c2-94a6-b1e19116d066 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1510 microversion: 2.1 time: 0.155580 Sep 19 15:13:57.810491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 245/501] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:57 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:57.861121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:57.861831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:57.868402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.868920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.869360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:57.870055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:57.870509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:57.870947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:58.010469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:58.018151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f85fb522-499e-4d77-a46d-3a55bfd160b7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.161486 Sep 19 15:13:58.018711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 257/502] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:57 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:58.201332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:58.202099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:58.208674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:58.209114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:58.209576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:58.210264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:58.210714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:58.211131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:58.272983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:58.280609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-699ecb96-780d-4b8e-ae39-47d8a4f571a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1270 microversion: 2.1 time: 0.083212 Sep 19 15:13:58.281163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 246/503] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:58 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:58.834211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:58.834898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:58.840891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:58.841383 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:58.841823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:58.842511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:58.842969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:58.843396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:58.974830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:58.983044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4f3618c1-6fde-44f3-8ff0-2b187acb112a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1510 microversion: 2.1 time: 0.153522 Sep 19 15:13:58.983608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 258/504] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:58 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:59.042385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:59.042940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:59.049004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:59.049526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:59.049966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:59.050653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:59.051492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:59.051908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:59.183345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:59.190973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-369bc9eb-3a72-4b62-9ecd-172208c15862 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1266 microversion: 2.1 time: 0.152692 Sep 19 15:13:59.192092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 247/505] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:59 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:13:59.304227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:13:59.304866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:13:59.310837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:59.313408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:59.313408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:59.313408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:13:59.313408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:13:59.313910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:13:59.376612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:13:59.385150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-28f98cc5-437e-4810-944e-3e6aa00a7292 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1270 microversion: 2.1 time: 0.085621 Sep 19 15:13:59.385734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 259/506] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:13:59 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:00.007210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:00.007822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:00.014254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.014736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.015207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.015900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.016353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.016834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.165015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:00.173057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-049848dc-423c-45b4-aad9-11de2995e286 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1510 microversion: 2.1 time: 0.169823 Sep 19 15:14:00.173618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 248/507] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:00 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:00.214951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:00.215646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:00.221724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.222218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.222788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.223504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.223955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.224382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.408659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:00.409279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:00.413379 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:00.414120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:00.417612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.423041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.423041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.423041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.423041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.423441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.509261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:00.560366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:00.562123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:00.569427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-18117546-f7e8-413d-ab40-629705fc276e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1454 microversion: 2.1 time: 0.358586 Sep 19 15:14:00.584566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dc9beacd-b46d-43b6-9f3c-e91143fb6181 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1278 microversion: 2.1 time: 0.167604 Sep 19 15:14:00.592782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 249/508] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:00.592933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 260/509] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:00 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1454 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:00.599715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:00.600348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:00.607179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.607596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.608025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:00.608756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:00.609207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:00.609625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:01.119997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:01.131327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7df8b127-5328-4ba4-a48c-3d9e01233d66 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1454 microversion: 2.1 time: 0.531805 Sep 19 15:14:01.131327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 250/510] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:00 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1454 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:01.195836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:01.197306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:01.203818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:01.206139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:01.206139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:01.206654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:01.207180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:01.208000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:01.451410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:01.453593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:01.460396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b58b20ad-3eec-4d50-9be3-2b9d6924d2cf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1510 microversion: 2.1 time: 0.269054 Sep 19 15:14:01.460997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 261/511] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:01 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:01.601622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:01.602510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:01.609411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:01.613552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:01.613552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:01.613552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:01.613552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:01.614022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:01.678373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:01.686451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-944b9bbf-5814-4d67-a47b-55ff6fa210e0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1276 microversion: 2.1 time: 0.089344 Sep 19 15:14:01.687066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 251/512] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:01 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:02.486272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:02.486873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:02.494235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:02.494716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:02.495147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:02.495865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:02.496316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:02.496986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:02.631793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:02.639794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-364259fb-0d5e-45d6-9b6c-0fb1fdf10998 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1510 microversion: 2.1 time: 0.157793 Sep 19 15:14:02.640358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 262/513] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:02 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:02.712377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:02.713065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:02.720664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:02.721163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:02.721762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:02.722965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:02.723759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:02.724303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:02.867890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:02.875676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-074c0c2f-0829-4f5b-b86e-0d2175f934f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.168221 Sep 19 15:14:02.876244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 252/514] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:03.285572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-28e2487b-501b-4b19-947a-2f1c5518fb10 req-1a8ac150-26d2-4f8d-b6a4-2547263e8814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609cf815-b2a9-4258-82a9-29d7eded8012", "tag": "ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:03.296572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-28e2487b-501b-4b19-947a-2f1c5518fb10 req-1a8ac150-26d2-4f8d-b6a4-2547263e8814 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:03.297187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-28e2487b-501b-4b19-947a-2f1c5518fb10 req-1a8ac150-26d2-4f8d-b6a4-2547263e8814 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:03.297876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-28e2487b-501b-4b19-947a-2f1c5518fb10 req-1a8ac150-26d2-4f8d-b6a4-2547263e8814 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:03.311900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-28e2487b-501b-4b19-947a-2f1c5518fb10 req-1a8ac150-26d2-4f8d-b6a4-2547263e8814 service nova] Creating event network-changed:ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c for instance 609cf815-b2a9-4258-82a9-29d7eded8012 on hv-cinder-75671 Sep 19 15:14:03.318782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-28e2487b-501b-4b19-947a-2f1c5518fb10 req-1a8ac150-26d2-4f8d-b6a4-2547263e8814 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037160 Sep 19 15:14:03.320337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 263/515] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:03.663746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:03.664628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:03.670926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:03.671658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:03.672079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:03.672824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:03.673373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:03.673783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:03.834051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:03.843385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2a0ded65-a6f0-4e6f-8717-7f7523a88dd4 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1510 microversion: 2.1 time: 0.183364 Sep 19 15:14:03.844069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 253/516] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:03 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:03.904067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:03.905397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:03.912318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:03.915107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:03.915107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:03.915107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:03.915107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:03.915489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:04.063568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:04.075014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-325fb740-259e-496a-a112-45b2e18a2ef6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.174963 Sep 19 15:14:04.076516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 264/517] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:04.867987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:04.868631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:04.875034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:04.875522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:04.875954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:04.876690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:04.877212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:04.877646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:05.098563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:05.099594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:05.106280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:05.106918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:05.108613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:05.109734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:05.110653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:05.111139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:05.112316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:05.127220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-aecf00ed-2c44-4d3e-8ed0-3aebc18946ce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1516 microversion: 2.1 time: 0.263729 Sep 19 15:14:05.128277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 254/518] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:04 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:05.411839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:05.419850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0494622-ee36-4814-8792-e665ff953edc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.325820 Sep 19 15:14:05.421706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 265/519] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:05 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:05.632932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-b0711eb2-cfb7-4281-b8a5-5f8da2a04a56 req-03ff4d31-4e6f-4e3b-a37e-64812be3d27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed221b61-f2e4-4a1c-88db-8ee956c45e7a", "tag": "3d83abc7-f529-4348-8819-5564b12f7aa1"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:05.642499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-b0711eb2-cfb7-4281-b8a5-5f8da2a04a56 req-03ff4d31-4e6f-4e3b-a37e-64812be3d27c service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:05.642981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-b0711eb2-cfb7-4281-b8a5-5f8da2a04a56 req-03ff4d31-4e6f-4e3b-a37e-64812be3d27c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:05.643414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-b0711eb2-cfb7-4281-b8a5-5f8da2a04a56 req-03ff4d31-4e6f-4e3b-a37e-64812be3d27c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:05.655317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-b0711eb2-cfb7-4281-b8a5-5f8da2a04a56 req-03ff4d31-4e6f-4e3b-a37e-64812be3d27c service nova] Creating event network-changed:3d83abc7-f529-4348-8819-5564b12f7aa1 for instance ed221b61-f2e4-4a1c-88db-8ee956c45e7a on hv-cinder-75671 Sep 19 15:14:05.661153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-b0711eb2-cfb7-4281-b8a5-5f8da2a04a56 req-03ff4d31-4e6f-4e3b-a37e-64812be3d27c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Sep 19 15:14:05.662434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 255/520] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:14:06.448958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:06.449840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:06.458391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:06.458990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:06.459437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:06.460438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:06.460923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:06.461347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:06.598038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:06.606301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6a2fb258-a4ad-4bdb-8875-5203dd7b7b4e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.162932 Sep 19 15:14:06.607114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 266/521] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:06 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:07.629814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:07.630504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:07.637027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:07.637504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:07.637944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:07.638632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:07.639141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:07.639487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:07.776496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:07.786442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5dd19149-6083-4591-99b0-4f464b22d68e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.160075 Sep 19 15:14:07.787044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 256/522] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:07 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:08.809008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:08.809614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:08.818540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:08.819040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:08.819459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:08.820148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:08.820644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:08.821064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:08.949487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2c4673d-7d5e-4044-bc40-553ea4602fac tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'create', calling method: .version_select at 0x7f41fb615310>, body: {"keypair": {"name": "tempest-keypair-447865486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5rgy7wj4sPQTiNcbDd+f5TqSs2IPTDD5nb2lznWVQop4+WmcphCgpxZ/W7Toaa5OLAKSGToul6fO7dFQcz8mUdN7P0UCw10Zi4+Ek237ThwEoFEbN49OO1T5CctSvplw=="}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:08.957666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:08.965616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-f2c4673d-7d5e-4044-bc40-553ea4602fac tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for project 677200be9d434857877c452db7ad4b20. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:14:08.965785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-db8ecd76-3067-41eb-81f5-1cf8b8505c15 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.160603 Sep 19 15:14:08.966364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 267/523] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:08.969745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-f2c4673d-7d5e-4044-bc40-553ea4602fac tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for user 338bde3096e44d81b2157690c75bfa05 and project 677200be9d434857877c452db7ad4b20. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:14:09.053794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2c4673d-7d5e-4044-bc40-553ea4602fac tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108030 Sep 19 15:14:09.054396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 257/524] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:14:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:14:09.988706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:09.989490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:09.995507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:09.995991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:09.996429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:09.997144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:09.997602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:09.998048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:10.146629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:10.154396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f5f44c5b-065c-43e9-ba08-788188a3cc7d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.169645 Sep 19 15:14:10.154958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 268/525] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:11.178214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:11.178831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:11.186524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:11.187006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:11.187441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:11.188141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:11.189057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:11.193425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:11.194528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:11.267616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1114122079", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54f4077a-9f0c-4643-b263-c7bd1ff20ccb"}], "security_groups": [{"name": "tempest-securitygroup--1321321453"}], "key_name": "tempest-keypair-447865486", "user_data": "}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:11.334844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:11.343009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-95b96f14-b0f8-4d6c-afba-b89e3d43fd6f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.169516 Sep 19 15:14:11.343578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 258/526] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:11 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:11.377433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] validate_networks() for [('54f4077a-9f0c-4643-b263-c7bd1ff20ccb', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:14:12.012468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:14:12.012959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:14:12.013601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:14:12.014003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:14:12.014442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:14:12.024890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:12.025242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:12.025680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:12.026397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:12.026848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:12.027305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:12.045931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for project 677200be9d434857877c452db7ad4b20. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:14:12.050005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Getting quotas for user 338bde3096e44d81b2157690c75bfa05 and project 677200be9d434857877c452db7ad4b20. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:14:12.066342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:14:12.068945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:14:12.181941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62845aa5-fcc5-431d-95f6-0bd5492dad5a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.918427 Sep 19 15:14:12.182589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 269/527] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:14:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:14:12.197502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-82425661-b94c-415e-a6e2-26e7416defce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:12.198497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-82425661-b94c-415e-a6e2-26e7416defce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:12.262039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-82425661-b94c-415e-a6e2-26e7416defce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:12.270984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-82425661-b94c-415e-a6e2-26e7416defce tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1245 microversion: 2.1 time: 0.078721 Sep 19 15:14:12.270984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 259/528] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:12 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:12.366036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:12.366641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:12.372627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:12.373119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:12.373551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:12.374239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:12.374694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:12.375110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:12.511632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:12.519516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fe75c8de-e928-4bf8-9787-25931d23c66b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.157355 Sep 19 15:14:12.520111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 270/529] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:13.291848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:13.292455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:13.301066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:13.302312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:13.302851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:13.303552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:13.304011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:13.304441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:13.366428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:13.374976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-632dd7cb-d6a5-4bf0-b2fc-4fb0051b279f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1249 microversion: 2.1 time: 0.086815 Sep 19 15:14:13.384983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 260/530] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:13 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:13.543790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:13.545111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:13.551019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:13.551503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:13.552230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:13.553181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:13.553638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:13.554065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:13.688246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:13.696466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9c74defa-4cab-42ca-8534-cc64c2b93051 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.157017 Sep 19 15:14:13.697039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 271/531] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:14.217506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-bc004d93-671b-40b6-9ae6-06f6c87964d7 req-c97d7521-1fca-40e7-a539-75678f1cea31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed221b61-f2e4-4a1c-88db-8ee956c45e7a", "name": "network-vif-plugged", "status": "completed", "tag": "3d83abc7-f529-4348-8819-5564b12f7aa1"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:14.227196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-bc004d93-671b-40b6-9ae6-06f6c87964d7 req-c97d7521-1fca-40e7-a539-75678f1cea31 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:14.227677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-bc004d93-671b-40b6-9ae6-06f6c87964d7 req-c97d7521-1fca-40e7-a539-75678f1cea31 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:14.228111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-bc004d93-671b-40b6-9ae6-06f6c87964d7 req-c97d7521-1fca-40e7-a539-75678f1cea31 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:14.239522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-bc004d93-671b-40b6-9ae6-06f6c87964d7 req-c97d7521-1fca-40e7-a539-75678f1cea31 service nova] Creating event network-vif-plugged:3d83abc7-f529-4348-8819-5564b12f7aa1 for instance ed221b61-f2e4-4a1c-88db-8ee956c45e7a on hv-cinder-75671 Sep 19 15:14:14.244770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-bc004d93-671b-40b6-9ae6-06f6c87964d7 req-c97d7521-1fca-40e7-a539-75678f1cea31 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Sep 19 15:14:14.245348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 261/532] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:14.397697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:14.398305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:14.409663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:14.410159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:14.410597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:14.411485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:14.411938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:14.412363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:14.479847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:14.488055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d6cc5a2c-4fca-4c35-92b5-249f9e1add88 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1297 microversion: 2.1 time: 0.094044 Sep 19 15:14:14.492622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 272/533] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:14 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:14.721525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:14.722148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:14.728711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:14.729668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:14.730179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:14.730881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:14.731340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:14.731766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:15.027954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:15.036554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1f564f97-949e-40a4-8dd7-12609c1c5a4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.319362 Sep 19 15:14:15.037121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 262/534] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:14 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:15.512076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:15.512745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:15.518755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:15.519242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:15.519683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:15.520375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:15.520870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:15.521315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:15.595717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:15.604799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d464cc1a-9548-49e6-8fef-2bddb6afa795 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1303 microversion: 2.1 time: 0.096298 Sep 19 15:14:15.605373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 273/535] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:15 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:16.059778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:16.062254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:16.066920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.067485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.067927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.069310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.069879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.070304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.296757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:16.305298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8ad1bc0f-767c-43ed-9e48-6bf5aeb93eff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.249212 Sep 19 15:14:16.305982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 263/536] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:16.630312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:16.635699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:16.637658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.638148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.638641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.639348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:16.639808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:16.640240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:16.865977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:16.873636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-44028387-43f7-44d3-9142-27ade92258c8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.247148 Sep 19 15:14:16.874257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 274/537] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:16 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:17.329083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:17.329808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:17.335900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:17.336419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:17.336887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:17.337589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:17.338048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:17.338472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:17.508367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:17.516053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-14ae8a85-b194-45b2-b820-e0ced5416fcc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.191083 Sep 19 15:14:17.516647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 264/538] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:17 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:17.554880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-291beee1-12cc-4a94-b453-9e774fa982e8 req-3faaa317-41c4-4744-8ece-bf98773b2606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55f8598-7398-40de-a1b8-e54986ebcdc9", "tag": "f7d13ef8-b77b-418b-b4ac-c99317b7c283"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:17.564697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-291beee1-12cc-4a94-b453-9e774fa982e8 req-3faaa317-41c4-4744-8ece-bf98773b2606 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:17.565172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-291beee1-12cc-4a94-b453-9e774fa982e8 req-3faaa317-41c4-4744-8ece-bf98773b2606 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:17.565596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-291beee1-12cc-4a94-b453-9e774fa982e8 req-3faaa317-41c4-4744-8ece-bf98773b2606 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:17.576627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-291beee1-12cc-4a94-b453-9e774fa982e8 req-3faaa317-41c4-4744-8ece-bf98773b2606 service nova] Creating event network-changed:f7d13ef8-b77b-418b-b4ac-c99317b7c283 for instance f55f8598-7398-40de-a1b8-e54986ebcdc9 on hv-cinder-75671 Sep 19 15:14:17.581954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-291beee1-12cc-4a94-b453-9e774fa982e8 req-3faaa317-41c4-4744-8ece-bf98773b2606 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031672 Sep 19 15:14:17.582548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 275/539] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:14:17.897471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:17.898206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:17.904152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:17.904680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:17.905120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:17.905812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:17.906273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:17.906701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:18.034612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:18.043717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-084447cd-b060-491f-8f5e-52f5b456e182 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.150455 Sep 19 15:14:18.044308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 265/540] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:17 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:18.540247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:18.540992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:18.547141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:18.547625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:18.548062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:18.548781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:18.549240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:18.549665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:18.681048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:18.688636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6dd3e6fc-605e-4022-8b45-74bdceb55c5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.153472 Sep 19 15:14:18.689197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 276/541] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:18 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:19.066310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:19.066926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:19.073898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:19.074388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:19.074826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:19.075518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:19.075971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:19.076391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:19.205205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:19.213431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6637f35c-891e-4460-a22a-ef18b4d0b8f1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.151033 Sep 19 15:14:19.213994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 266/542] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:19 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:19.712685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:19.713326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:19.719261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:19.719741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:19.720173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:19.720884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:19.721339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:19.721763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:19.854043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:19.861918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-91b03ac9-28a4-4f90-bdf6-34fad564b3a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.154094 Sep 19 15:14:19.862483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 277/543] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:19 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:20.235764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:20.236378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:20.243377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:20.243863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:20.244305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:20.245165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:20.245692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:20.246124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:20.376229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:20.384497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7a2e0e39-108f-44c1-9274-c3f086c37a32 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.152819 Sep 19 15:14:20.385064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 267/544] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:20 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:20.885052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:20.885665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:20.891716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:20.892196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:20.892667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:20.893352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:20.893804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:20.894227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:21.024795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:21.032569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7535c0f7-c8d1-42a9-a942-a22ad3bfe6df tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.152112 Sep 19 15:14:21.033082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 278/545] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:21.407300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:21.407912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:21.415148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:21.415631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:21.416068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:21.416791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:21.417249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:21.417676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:21.549965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:21.558594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8609ec99-c766-45c6-a428-2e8e257822de tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.155173 Sep 19 15:14:21.559156 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 268/546] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:21 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:22.055377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:22.056278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:22.059204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:22.061427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=6 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:22.065356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.066869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.066869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.067104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.067397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.067897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.201184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:22.209474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d34c4d82-fa9c-4f10-93cb-5aaeea1a1623 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1318 microversion: 2.1 time: 0.157567 Sep 19 15:14:22.210426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 279/547] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:22.582482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:22.583041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:22.585060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:22.590306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.590785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.591219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.591905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:22.592364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:22.592812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:22.816711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:22.825316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a85d01b6-5d9b-440c-bf3d-02e49b6287ed tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.247050 Sep 19 15:14:22.826357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 269/548] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:22 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:23.233311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:23.233921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:23.239902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.240382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.240865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.241655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.242248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.242679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.257409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:23.445176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:23.452820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ceba11c7-a5ee-4b0e-8318-3e64231d6589 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1506 microversion: 2.1 time: 0.223516 Sep 19 15:14:23.453310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 280/549] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:23 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:23.475564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99126f62-c0bd-413a-a64c-5903c85c602a", "device": "/dev/sdb"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:23.478851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:23.485605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.485948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.486387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.487291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.487787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.488329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.849494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:23.850099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:23.856452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.856962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.857396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.858081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:23.858530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:23.858950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:23.986787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:23.995197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8a5ac7a2-c225-46f4-ab7e-907679264168 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.149523 Sep 19 15:14:23.995736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 281/550] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:23 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:25.018784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:25.019401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:25.025984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.026475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.026916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.027615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:25.028093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:25.028581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:25.162122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:25.169927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8e8451b-c418-48ae-846d-2cbc405f89ef tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.155047 Sep 19 15:14:25.170490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 282/551] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:25 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:26.192575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:26.193178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:26.199150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:26.199666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:26.200136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:26.200877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:26.201328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:26.201761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:26.329169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:26.337712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2d72f722-933c-49d1-a034-1aa9f6eccc9d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.149111 Sep 19 15:14:26.338427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 283/552] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:26 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:27.361432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:27.362147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:27.364114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:27.369055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:27.369586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:27.370024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:27.370761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:27.371210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:27.371638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:27.511097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:27.518764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c44699d5-4ea5-4329-8235-8ca7a13f6154 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.161207 Sep 19 15:14:27.519313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 284/553] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:27 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:14:28.393356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4d1f38db-91ef-4c98-a6bf-b617484d33b7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "POST /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.921715 Sep 19 15:14:28.394007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 270/554] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:14:23 2022] POST /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments => generated 194 bytes in 4923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:28.542398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:28.543015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:28.548901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:28.549375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:28.553206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:28.553206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:28.553206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:28.553206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:28.683313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:28.691256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-084776d1-7029-4156-93ef-2781d157109d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.152825 Sep 19 15:14:28.691804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 285/555] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:28 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:29.222522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-6b283c60-3722-4df2-bd76-24f665e16216 req-46da7e79-0b41-4014-bfca-2c6a9f020c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55f8598-7398-40de-a1b8-e54986ebcdc9", "name": "network-vif-plugged", "status": "completed", "tag": "f7d13ef8-b77b-418b-b4ac-c99317b7c283"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:29.228779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:29.234374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-6b283c60-3722-4df2-bd76-24f665e16216 req-46da7e79-0b41-4014-bfca-2c6a9f020c4a service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:29.234851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-6b283c60-3722-4df2-bd76-24f665e16216 req-46da7e79-0b41-4014-bfca-2c6a9f020c4a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:29.235285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-6b283c60-3722-4df2-bd76-24f665e16216 req-46da7e79-0b41-4014-bfca-2c6a9f020c4a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:29.246408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-6b283c60-3722-4df2-bd76-24f665e16216 req-46da7e79-0b41-4014-bfca-2c6a9f020c4a service nova] Creating event network-vif-plugged:f7d13ef8-b77b-418b-b4ac-c99317b7c283 for instance f55f8598-7398-40de-a1b8-e54986ebcdc9 on hv-cinder-75671 Sep 19 15:14:29.251282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-6b283c60-3722-4df2-bd76-24f665e16216 req-46da7e79-0b41-4014-bfca-2c6a9f020c4a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Sep 19 15:14:29.251891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 271/556] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:29.716948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:29.717417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:29.725662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:29.726754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:29.731058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:29.731058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:29.731058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:29.731058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:29.884082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:29.891660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fc868803-400e-4f46-a834-973eb8e7efd8 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.180314 Sep 19 15:14:29.892211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 286/557] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:29 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:30.891746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:30.892336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:30.899097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:30.899581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:30.900020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:30.900750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:30.901213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:30.901675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:30.914616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:30.915462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:30.922188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:30.922899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:30.923409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:30.924239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:30.925047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:30.925623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:30.926483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8a577ed7-d4cb-4ae8-be48-331bb9c84c53 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/ips" status: 200 len: 150 microversion: 2.1 time: 0.039702 Sep 19 15:14:30.934542 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 272/558] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:14:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:31.081475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:31.089561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4a63f708-ee5d-4967-b1a9-947ff7249b4a tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.179268 Sep 19 15:14:31.090128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 287/559] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:30 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:31.181897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:31.182390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:31.188532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:31.189012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:31.189436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:31.190150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:31.190606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:31.191023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:31.214231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b1dd7b4-0469-47ce-b83f-a5a660154756 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258/ips" status: 200 len: 146 microversion: 2.1 time: 0.038175 Sep 19 15:14:31.214809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 273/560] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:14:31 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:32.114053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:32.114680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:32.121699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:32.122179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:32.122608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:32.123287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:32.123737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:32.124157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:32.431557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:32.439521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8a0c7a07-1333-41b5-a7c2-5277f7d9db85 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1371 microversion: 2.1 time: 0.329379 Sep 19 15:14:32.440095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 288/561] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:32 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:33.463830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:33.464389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:33.472232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.472746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.473213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.473920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.474378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.474804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.659562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:14:33.667293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5311d64a-2f7d-4b06-a4f3-aa2320174f2d tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 200 len: 1566 microversion: 2.1 time: 0.207534 Sep 19 15:14:33.667857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 274/562] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:14:33 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:14:33.690365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:33.690856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:33.697533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.698053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.698577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.699285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.699747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.700180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.747945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:33.752031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:33.758881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.760162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.760933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.761474 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:33.761999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:33.762490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:33.788405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1df66f2d-3b53-4674-a33f-a860eca341b3 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101806 Sep 19 15:14:33.789107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 289/563] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:14:33 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:34.018896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:14:34.535656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9cc7e81c-16d8-4df7-8ee4-448db191082c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795357 Sep 19 15:14:34.536320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 275/564] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:14:33 2022] POST /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:14:35.078376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-d2498ed8-a576-45a3-aebe-b6de1995cec1 req-c9cab78d-e77d-4ac5-8ce2-4eac3ace4313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55f8598-7398-40de-a1b8-e54986ebcdc9", "tag": "f7d13ef8-b77b-418b-b4ac-c99317b7c283"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:35.088561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d2498ed8-a576-45a3-aebe-b6de1995cec1 req-c9cab78d-e77d-4ac5-8ce2-4eac3ace4313 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:35.089213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d2498ed8-a576-45a3-aebe-b6de1995cec1 req-c9cab78d-e77d-4ac5-8ce2-4eac3ace4313 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:35.089715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-d2498ed8-a576-45a3-aebe-b6de1995cec1 req-c9cab78d-e77d-4ac5-8ce2-4eac3ace4313 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:35.102453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-d2498ed8-a576-45a3-aebe-b6de1995cec1 req-c9cab78d-e77d-4ac5-8ce2-4eac3ace4313 service nova] Creating event network-changed:f7d13ef8-b77b-418b-b4ac-c99317b7c283 for instance f55f8598-7398-40de-a1b8-e54986ebcdc9 on hv-cinder-75671 Sep 19 15:14:35.108800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-d2498ed8-a576-45a3-aebe-b6de1995cec1 req-c9cab78d-e77d-4ac5-8ce2-4eac3ace4313 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034005 Sep 19 15:14:35.109462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 290/565] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:35.248610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b976ad39-2fa4-4768-92ec-9275b6839a2c"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:35.251004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:35.257093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:35.257580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:35.258017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:35.258720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:35.259177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:35.259854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:36.320950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:14:36.323757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:36.329806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:36.330275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:36.330703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:36.331380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:36.331827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:36.332241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:36.353056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-617cb935-5261-4b51-a4f2-5054cc6756e1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "POST /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.109657 Sep 19 15:14:36.357482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 276/566] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:14:35 2022] POST /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258/os-volume_attachments => generated 194 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:14:36.627066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ad33d5d2-e936-40c6-b8f0-534ae982b691 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "POST /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede/action" status: 200 len: 30999 microversion: 2.20 time: 0.310146 Sep 19 15:14:36.627778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 291/567] 10.222.0.75 () {62 vars in 1319 bytes} [Mon Sep 19 15:14:36 2022] POST /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede/action => generated 30999 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:14:43.205292 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:14:43.205870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:14:43.211967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:43.212435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:43.212885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:43.213560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:14:43.214005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:14:43.214420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:14:43.239597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6caa847c-5e56-4020-9675-e2b60f44540d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede/ips" status: 200 len: 150 microversion: 2.20 time: 0.039190 Sep 19 15:14:43.240156 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 277/568] 10.222.0.75 () {60 vars in 1289 bytes} [Mon Sep 19 15:14:43 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:15:39.361877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=15 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:39.362622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=61 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:39.363962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:15:39.364100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:15:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.75) !!! Sep 19 15:15:39.368727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0d5511c3-f228-4fa5-8bf5-74e61be49188 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: .version_select at 0x7f41fb826ee0>, body: {"keypair": {"name": "tempest-keypair-248631217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMhJlgBHCtz/LzTFkD5/I/QT7gzTY9Ej1DDVCDILbu57jrWDvZ1u3DDw5EtY1dS52IIrqEfQc2bkbRYyVds54EGtv6Rip5+kyugCWXrx5fIm6xHTfWLOQa3mucKATdHvg=="}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:39.388892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-0d5511c3-f228-4fa5-8bf5-74e61be49188 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:15:39.392944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-0d5511c3-f228-4fa5-8bf5-74e61be49188 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:15:39.452010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0d5511c3-f228-4fa5-8bf5-74e61be49188 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092041 Sep 19 15:15:39.452626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 292/569] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:15:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:15:41.555008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-722839585", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117"}], "security_groups": [{"name": "tempest-securitygroup--5857401"}], "key_name": "tempest-keypair-248631217", "user_data": "}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:41.564871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=13 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:41.565530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:41.661564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] validate_networks() for [('bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:15:42.079351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:15:42.079777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:15:42.080253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:15:42.080713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:15:42.081244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:15:42.089925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:42.090409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:42.090847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:42.092162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:42.092658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:42.093086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:42.110215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:15:42.114213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:15:42.125251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:15:42.127575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:15:42.323667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c2f1be92-9ffb-43a4-984c-ed8d867ad421 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.773077 Sep 19 15:15:42.324305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 278/570] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:15:41 2022] POST /compute/v2.1/servers => generated 399 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:15:42.337061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d79ff358-f9f8-4cfa-80a3-09cc0185ab64 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:42.337871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d79ff358-f9f8-4cfa-80a3-09cc0185ab64 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:42.405347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d79ff358-f9f8-4cfa-80a3-09cc0185ab64 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:42.412773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d79ff358-f9f8-4cfa-80a3-09cc0185ab64 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1240 microversion: 2.1 time: 0.080666 Sep 19 15:15:42.413548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 293/571] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:42 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:43.436365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:43.436996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:43.443852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:43.444336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:43.444803 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:43.445489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:43.445948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:43.446385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:43.511868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:43.522222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b907d427-593d-4c0c-886d-eebf87198358 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1244 microversion: 2.1 time: 0.087548 Sep 19 15:15:43.522222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 279/572] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:43 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:44.543042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:44.543582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:44.552197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:44.552740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:44.553177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:44.553907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:44.554359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:44.554969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:44.621374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:44.629512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8dc249cd-b166-49c3-babf-db11007ac096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1292 microversion: 2.1 time: 0.090488 Sep 19 15:15:44.630078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 294/573] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:44 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:45.652626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:45.653482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:45.668003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:45.668584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:45.669026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:45.670522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:45.671357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:45.671792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:45.952387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:45.960075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-16709fbb-dd73-428d-927c-938e08eb33fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.311448 Sep 19 15:15:45.960665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 280/574] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:45 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:46.983799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:46.984452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:46.992192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:46.992811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:46.993463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:46.994476 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:46.994936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:46.995360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:47.093276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-860c39e1-fc5f-4861-b134-49074c975e79 req-378d55c7-b045-4530-adb6-605848a2c584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472c71ee-5670-4562-bfac-24f97b292419", "tag": "e8833669-37bc-41f4-94f2-f7306e2ebdf0"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:47.103571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-860c39e1-fc5f-4861-b134-49074c975e79 req-378d55c7-b045-4530-adb6-605848a2c584 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:47.104129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-860c39e1-fc5f-4861-b134-49074c975e79 req-378d55c7-b045-4530-adb6-605848a2c584 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:47.104588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-860c39e1-fc5f-4861-b134-49074c975e79 req-378d55c7-b045-4530-adb6-605848a2c584 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:47.118401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-860c39e1-fc5f-4861-b134-49074c975e79 req-378d55c7-b045-4530-adb6-605848a2c584 service nova] Creating event network-changed:e8833669-37bc-41f4-94f2-f7306e2ebdf0 for instance 472c71ee-5670-4562-bfac-24f97b292419 on hv-cinder-75671 Sep 19 15:15:47.125078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-860c39e1-fc5f-4861-b134-49074c975e79 req-378d55c7-b045-4530-adb6-605848a2c584 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122003 Sep 19 15:15:47.125672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 281/575] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:47.220913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:47.227312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e805eafe-713d-4d95-84ee-1c41df835b39 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.248193 Sep 19 15:15:47.227892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 295/576] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:46 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:48.253899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:48.254594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:48.261410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:48.261978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:48.262534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:48.263886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:48.264455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:48.264901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:48.395492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:48.403311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e402974e-3e40-4288-8057-9d6a9a2146fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.153695 Sep 19 15:15:48.404462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 282/577] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:48 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:49.426804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:49.427439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:49.434022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:49.434493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:49.434920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:49.435688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:49.436153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:49.436596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:49.571599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:49.579464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fd4f2db2-bdc3-4e94-99f5-0107925db787 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.156574 Sep 19 15:15:49.580025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 296/578] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:49 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:50.602959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:50.603795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:50.610613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:50.611095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:50.611526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:50.612214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:50.612690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:50.613112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:50.746242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:50.754634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-52c9b01b-0a60-445c-9c98-038d187b009b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.155525 Sep 19 15:15:50.755202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 283/579] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:50 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:51.780689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:51.781312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:51.787703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:51.788195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:51.788666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:51.789364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:51.789824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:51.790252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:52.002728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:52.010264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5cdaa93f-6021-46ea-965a-ade85e1522c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.234282 Sep 19 15:15:52.010831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 297/580] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:51 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:53.035073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:53.035630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:53.038128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:53.038802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:53.043729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:53.044222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:53.045270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:53.046443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:53.046618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:53.046988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:53.187468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:53.195128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7bdb6b33-ce49-4522-a47b-1ee3e4a8be41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.164043 Sep 19 15:15:53.195893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 284/581] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:53 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:15:54.022848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=6 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:15:54.080642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-36e223cd-491f-44f6-a017-cf2889eea625 req-613dec4c-5426-4fe5-bac6-640f0f0b22bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472c71ee-5670-4562-bfac-24f97b292419", "name": "network-vif-plugged", "status": "completed", "tag": "e8833669-37bc-41f4-94f2-f7306e2ebdf0"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:15:54.090058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-36e223cd-491f-44f6-a017-cf2889eea625 req-613dec4c-5426-4fe5-bac6-640f0f0b22bf service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:54.092302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-36e223cd-491f-44f6-a017-cf2889eea625 req-613dec4c-5426-4fe5-bac6-640f0f0b22bf service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:54.092302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-36e223cd-491f-44f6-a017-cf2889eea625 req-613dec4c-5426-4fe5-bac6-640f0f0b22bf service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:54.102153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-36e223cd-491f-44f6-a017-cf2889eea625 req-613dec4c-5426-4fe5-bac6-640f0f0b22bf service nova] Creating event network-vif-plugged:e8833669-37bc-41f4-94f2-f7306e2ebdf0 for instance 472c71ee-5670-4562-bfac-24f97b292419 on hv-cinder-75671 Sep 19 15:15:54.108061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-36e223cd-491f-44f6-a017-cf2889eea625 req-613dec4c-5426-4fe5-bac6-640f0f0b22bf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088665 Sep 19 15:15:54.109040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 298/582] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:15:54.220597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:54.221175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:54.227484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:54.227957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:54.228387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:54.229093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:54.229545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:54.229963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:54.361390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:54.369568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ed8b7fd2-bf85-479e-9afc-9601177930eb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.152838 Sep 19 15:15:54.370331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 285/583] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:54 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:55.395676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:55.396404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:55.402569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:55.403049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:55.403482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:55.405092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:55.405547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:55.405975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:55.541385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:55.549109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-14c2869a-28a8-464c-82b3-5f3e7b606c0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.158084 Sep 19 15:15:55.549672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 299/584] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:55 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:56.570844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:56.571454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:56.578833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:56.579353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:56.579788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:56.580498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:56.580952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:56.581377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:56.713977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:56.722269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0ad4bc8e-6522-4bc5-b741-e55dbc5b2b9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.155298 Sep 19 15:15:56.722831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 286/585] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:56 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:57.745750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:57.746360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:57.753256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:57.753740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:57.754172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:57.754868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:57.755320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:57.755742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:58.120187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:58.128643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6e1d24e1-cb5e-4f64-a6c9-c8b1d74a6cbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1363 microversion: 2.1 time: 0.386757 Sep 19 15:15:58.129229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 300/586] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:57 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:59.151047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:59.151661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:59.159402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:59.159960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:59.160396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:59.161119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:59.161574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:59.161995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:59.304587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:15:59.312215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3b29dd60-5eb3-4212-a847-946341ec873f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1554 microversion: 2.1 time: 0.164956 Sep 19 15:15:59.312814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 287/587] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:15:59 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:15:59.337362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:15:59.337362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:15:59.342819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:59.343300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:59.343740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:59.344437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:15:59.344923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:15:59.345352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:15:59.425109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e3f84fd2-e346-4245-af7e-020c3605921f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093852 Sep 19 15:15:59.425794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 301/588] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:15:59 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:16:00.425407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-3c435620-0918-45e5-a1bd-ae2a5b3c8b9d req-ed1d9891-2ba5-4e5f-9d84-c8b19adf680f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472c71ee-5670-4562-bfac-24f97b292419", "tag": "e8833669-37bc-41f4-94f2-f7306e2ebdf0"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:00.437626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-3c435620-0918-45e5-a1bd-ae2a5b3c8b9d req-ed1d9891-2ba5-4e5f-9d84-c8b19adf680f service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:00.438112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-3c435620-0918-45e5-a1bd-ae2a5b3c8b9d req-ed1d9891-2ba5-4e5f-9d84-c8b19adf680f service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:00.439061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-3c435620-0918-45e5-a1bd-ae2a5b3c8b9d req-ed1d9891-2ba5-4e5f-9d84-c8b19adf680f service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:00.450375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-3c435620-0918-45e5-a1bd-ae2a5b3c8b9d req-ed1d9891-2ba5-4e5f-9d84-c8b19adf680f service nova] Creating event network-changed:e8833669-37bc-41f4-94f2-f7306e2ebdf0 for instance 472c71ee-5670-4562-bfac-24f97b292419 on hv-cinder-75671 Sep 19 15:16:00.456512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-3c435620-0918-45e5-a1bd-ae2a5b3c8b9d req-ed1d9891-2ba5-4e5f-9d84-c8b19adf680f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034770 Sep 19 15:16:00.457226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 288/589] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:16:47.679421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:47.680210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=42 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:47.816186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:47.816738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:47.822618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:47.823304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:47.824050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:47.824940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:47.825398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:47.825814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:47.848396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lazy-loading 'flavor' on Instance uuid 31955ace-a21d-4a42-8e97-33da4bca71f0 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:16:48.077780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d2d3a16-9195-4170-89a9-66b71dc675f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "POST /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0/action" status: 202 len: 0 microversion: 2.1 time: 0.399743 Sep 19 15:16:48.078404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 302/590] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:16:47 2022] POST /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:16:48.084951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:48.085763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=54 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:16:48.089950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:48.090717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:48.097383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:48.097860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:48.098477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:48.099173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:48.099621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:48.100043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:48.235828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:48.244163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-668879f1-9ffd-4cfe-98ed-1df5cefc8a99 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160990 Sep 19 15:16:48.244767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 289/591] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:49.268826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:49.269564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:49.275708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:49.276194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:49.276665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:49.277355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:49.277812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:49.278233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:49.411492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:49.419240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-19d9d8c2-00c3-4aee-b7b5-85ac7c350477 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155143 Sep 19 15:16:49.419804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 303/592] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:50.443525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:50.444544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:50.451070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:50.451544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:50.451971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:50.452688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:50.453138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:50.453556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:50.592148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:50.600060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-51e91dd8-847a-4a9b-8c26-0b9dac6a3a7a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.161295 Sep 19 15:16:50.600649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 290/593] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:51.623716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:51.624328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:51.630822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:51.631300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:51.631728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:51.632444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:51.632917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:51.633335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:51.769881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:51.777633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0de5762c-c16b-4cfa-917e-40438fedb74f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157760 Sep 19 15:16:51.778197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 304/594] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:51.938519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5ed5c9-db73-4ffd-b2eb-cf8a42977a7e"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:16:51.941476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:51.947452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:51.947934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:51.948373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:51.949097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:51.949558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:51.949988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:52.740772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e249b0e2-0686-410e-8211-a0979a037499 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "POST /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860386 Sep 19 15:16:52.741388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 291/595] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:16:51 2022] POST /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:16:52.801633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:52.804388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:52.808837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:52.809325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:52.809765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:52.810459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:52.810916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:52.811345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:52.945405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:52.953119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6fc89fe3-0e04-4ebf-bacd-cc93fc2b014d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156335 Sep 19 15:16:52.953672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 305/596] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:53.978037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:53.978697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:53.985207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:53.985692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:53.986637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:53.987355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:53.987793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:53.988219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:54.120298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:54.128058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8c6a9efe-87ff-462d-835c-e7187cfc7f37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154817 Sep 19 15:16:54.128652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 292/597] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:55.151614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:55.152185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:55.160589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:55.161427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:55.161912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:55.162902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:55.163706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:55.164431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:55.327079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:55.336602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-feae68f0-091b-4879-b533-2283296a1f3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.188833 Sep 19 15:16:55.337186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 306/598] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:56.360733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:56.361972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:56.368363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:56.368928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:56.369326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:56.375801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:56.375801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:56.375801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:56.506096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:56.514136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ad1b3c2c-a391-43bd-bcf9-de46208003c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157595 Sep 19 15:16:56.514712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 293/599] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:57.538063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:57.538679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:57.545107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:57.545599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:57.546037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:57.546731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:57.547215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:57.547642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:57.681064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:57.689795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-46c61693-46dd-4fe5-aa6b-0ba71b5ebdfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155022 Sep 19 15:16:57.690353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 307/600] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:58.713426 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:58.713951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:58.723339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:58.723866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:58.724310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:58.725207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:58.725672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:58.726191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:58.864822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:16:58.873212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bc4d2a2a-e3f6-442f-8d86-1b34bb95f0db tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.163641 Sep 19 15:16:58.874599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 294/601] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:16:59.897413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:16:59.898058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:16:59.904539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.905032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.905560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:16:59.906145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:16:59.906599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:16:59.907020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:00.038807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:00.046618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-55e1f1ac-133c-403d-9ffd-e410ba18aa57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153049 Sep 19 15:17:00.047185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 308/602] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:16:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:01.069303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:01.069940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:01.076391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:01.076903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:01.077466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:01.078155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:01.078606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:01.079029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:01.213331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:01.221805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4c1effe4-1e74-4422-b775-271d3369156f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156114 Sep 19 15:17:01.222046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 295/603] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:02.245765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:02.246305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:02.253463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.254044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.254487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.255183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:02.255644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:02.256070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:02.386687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:02.395030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8026fa51-36c9-49f9-93ab-6e52894726ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153308 Sep 19 15:17:02.395597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 309/604] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:03.418153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:03.418766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:03.425584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:03.426061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:03.426495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:03.427181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:03.427627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:03.428044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:03.614208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:03.622141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-80f12a56-82c3-49d8-bc5d-494d646c9aea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.207678 Sep 19 15:17:03.622968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 296/605] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:04.645585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:04.646196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:04.652732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:04.653157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:04.653594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:04.654285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:04.654744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:04.655169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:04.791308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:04.801549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f944b3dc-90ba-4c6e-a1f8-5b17de8a43c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158223 Sep 19 15:17:04.801549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 310/606] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:05.822848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:05.823471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:05.830824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.831385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.831958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.832461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:05.832945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:05.833374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:05.983835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:05.991713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-eec1fe3b-d201-4ef6-8702-2bfe4f6ec664 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.172811 Sep 19 15:17:05.992293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 297/607] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:07.022218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:07.022832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:07.029134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:07.029573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:07.030009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:07.030700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:07.031159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:07.031583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:07.158379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:07.166296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f3971db0-833c-4075-abc3-7c79e2ea5ba7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.147955 Sep 19 15:17:07.166854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 311/608] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:08.190870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:08.191476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:08.197880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:08.198361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:08.198796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:08.199484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:08.199940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:08.200363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:08.333595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:08.341334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-05542001-abf8-42ef-96da-e6f25f317e5a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154644 Sep 19 15:17:08.341936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 298/609] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:09.364752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:09.365407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:09.371829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:09.372316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:09.372767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:09.373448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:09.373899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:09.374319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:09.506979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:09.514768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0eef0f88-b26f-4db3-b261-94afda295ea0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154001 Sep 19 15:17:09.515325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 312/610] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:10.289933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-0274496a-6344-43cc-a40c-7b74ff445b37 req-2581e28f-7c34-4470-9a7c-7b437094282a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31955ace-a21d-4a42-8e97-33da4bca71f0", "name": "network-vif-unplugged", "status": "completed", "tag": "a7905d0d-ddbc-4310-b98e-9d7db60cfd0d"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:10.299990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-0274496a-6344-43cc-a40c-7b74ff445b37 req-2581e28f-7c34-4470-9a7c-7b437094282a service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:10.300470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-0274496a-6344-43cc-a40c-7b74ff445b37 req-2581e28f-7c34-4470-9a7c-7b437094282a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:10.300924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-0274496a-6344-43cc-a40c-7b74ff445b37 req-2581e28f-7c34-4470-9a7c-7b437094282a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:10.311509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-0274496a-6344-43cc-a40c-7b74ff445b37 req-2581e28f-7c34-4470-9a7c-7b437094282a service nova] Creating event network-vif-unplugged:a7905d0d-ddbc-4310-b98e-9d7db60cfd0d for instance 31955ace-a21d-4a42-8e97-33da4bca71f0 on hv-cinder-75671 Sep 19 15:17:10.319013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-0274496a-6344-43cc-a40c-7b74ff445b37 req-2581e28f-7c34-4470-9a7c-7b437094282a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030453 Sep 19 15:17:10.319013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 299/611] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:10.538018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:10.538629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:10.545003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:10.545484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:10.545921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:10.546613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:10.547069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:10.547497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:10.676626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:10.684261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b4065100-1f4a-45fe-bc1d-b43b069f24b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150243 Sep 19 15:17:10.684857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 313/612] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:11.710862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:11.711695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:11.718043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.718529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.718959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:11.719656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:11.720241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:11.720706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:12.089559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:12.097766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2f71a55c-29a8-4507-9a9b-765805573344 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.393445 Sep 19 15:17:12.098327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 300/613] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:13.121938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:13.122545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:13.129211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:13.129686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:13.130114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:13.130791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:13.131237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:13.131653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:13.260361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:13.267923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f1be84c6-44ce-48a4-ba99-922f01b37bf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.149857 Sep 19 15:17:13.268497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 314/614] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:14.291148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:14.291769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:14.298275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:14.298757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:14.299196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:14.299889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:14.300347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:14.300805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:14.435515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:14.444019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1da1746c-18c1-4162-9a42-8d6c52e8230d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156704 Sep 19 15:17:14.444608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 301/615] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:15.467825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:15.468431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:15.474913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:15.475396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:15.475832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:15.476563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:15.477097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:15.477526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:15.606065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:15.614429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ea60b8e6-681f-4cf9-8994-433c01d50aba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150466 Sep 19 15:17:15.614998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 315/616] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:16.638524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:16.639134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:16.645543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:16.646022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:16.646455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:16.647169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:16.647600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:16.648019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:16.779983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:16.788265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1d62a25b-90ec-475a-830c-fdd8b92a640e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153632 Sep 19 15:17:16.788854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 302/617] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:17.811775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:17.812375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:17.814972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=29 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:17.819532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:17.820007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:17.821049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:17.821729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:17.822177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:17.822594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:17.826420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:17.954883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:17.962612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c77dd7a1-3114-478d-9468-8895ca0dadba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154665 Sep 19 15:17:17.963178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 316/618] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:18.986455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:18.987070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:18.989482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=29 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:18.994658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:19.001810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:19.001810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:19.001810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:19.001810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:19.002120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:19.002120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:19.129573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:19.137091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c20d130b-7ebb-4a3a-83bc-1b6b9a18a900 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154943 Sep 19 15:17:19.137653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 303/619] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:20.160844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:20.161431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:20.163926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:17:20.164060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:17:20.172053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:20.172555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:20.173514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:20.174489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:20.174941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:20.175364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:20.312847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:20.320884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-78f72604-59ee-4dd7-81f4-a5a5d15edf3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.164308 Sep 19 15:17:20.321481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 317/620] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:21.343674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:21.344290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:21.351533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:21.352016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:21.352455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:21.353177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:21.353636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:21.354065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:21.487855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:21.495690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1b061f72-6fd2-4794-ad5f-7454f44da8b8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155854 Sep 19 15:17:21.496259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 304/621] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:22.518027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:22.518580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:22.524997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:22.525512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:22.525953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:22.526646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:22.527104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:22.527529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:22.661251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:22.669051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f7aca254-44ae-40be-8ebd-e1aa3c332756 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155274 Sep 19 15:17:22.669612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 318/622] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:23.692801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:23.693428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:23.695700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:17:23.695852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:17:23.703514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:23.703997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:23.705108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:23.705895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:23.706358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:23.706790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:23.840970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:23.849251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5ec2d66a-eece-4acb-bd99-6bf7fe6f2405 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160482 Sep 19 15:17:23.849810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 305/623] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:24.872324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:24.872963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:24.879400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:24.879880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:24.880315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:24.881103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:24.881558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:24.881983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:25.010883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:25.019025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-49aab714-ddbc-4e45-80a5-4e004c448058 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150669 Sep 19 15:17:25.019583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 319/624] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:26.042627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:26.043157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:26.050159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.050678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.051118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.051812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.052270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.052725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.192277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:26.200166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6aba1a7e-6fab-4598-a351-13ee41f05dca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.161547 Sep 19 15:17:26.200892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 306/625] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:26.594366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:26.594917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:26.601372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.601846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.602274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.602961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.603411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.603825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.629120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:17:26.897187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c295bf60-33ef-4654-aaae-bc004dff7f1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "DELETE /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 204 len: 0 microversion: 2.1 time: 0.403367 Sep 19 15:17:26.897765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 320/626] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:17:26 2022] DELETE /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:17:26.905891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:26.909394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:26.912622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.913115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.913555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:26.914256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:26.914717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:26.915147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:27.050033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:27.057671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bb94df75-3d18-4bd2-aef1-67b0d5cd113f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1578 microversion: 2.1 time: 0.155678 Sep 19 15:17:27.058224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 307/627] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:26 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:27.224485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:27.225209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:27.231014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:27.231481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:27.231902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:27.232607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:27.233052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:27.233711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:27.368300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:27.375976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-64d0a086-18fb-48af-9b45-af98e5b2a521 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156401 Sep 19 15:17:27.376858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 321/628] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:28.081515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:28.082161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:28.088733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:28.089212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:28.089640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:28.090323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:28.090768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:28.091186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:28.223900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:28.231645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-63695947-908a-412d-a089-6235506c978e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1578 microversion: 2.1 time: 0.154588 Sep 19 15:17:28.232209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 308/629] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:28 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:28.399352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:28.399923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:28.406293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:28.406777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:28.407213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:28.407928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:28.408385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:28.408835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:28.545426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:28.553940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9bc847f1-fd2c-498f-b952-76c22e7713cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158474 Sep 19 15:17:28.554539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 322/630] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:29.256069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:29.256835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:29.263278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:29.263760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:29.264197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:29.264969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:29.265424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:29.265851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:29.499083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:29.507564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea511ac6-54fd-4d76-9981-4c0127ed945f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1578 microversion: 2.1 time: 0.256041 Sep 19 15:17:29.508066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 309/631] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:29 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1578 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:29.577345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:29.578069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:29.584765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:29.585242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:29.585677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:29.586359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:29.586809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:29.587224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:29.834530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:29.842420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d34b41a8-3749-44c2-b21d-a269258e63cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.268989 Sep 19 15:17:29.843188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 323/632] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:30.350825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-70bbc73f-33f8-42bc-80e1-e167b867e932 req-441e820d-5d28-49e1-9070-fa72c3775b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609cf815-b2a9-4258-82a9-29d7eded8012", "name": "network-vif-deleted", "tag": "ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:30.363159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-70bbc73f-33f8-42bc-80e1-e167b867e932 req-441e820d-5d28-49e1-9070-fa72c3775b0d service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.363742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-70bbc73f-33f8-42bc-80e1-e167b867e932 req-441e820d-5d28-49e1-9070-fa72c3775b0d service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.364181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-70bbc73f-33f8-42bc-80e1-e167b867e932 req-441e820d-5d28-49e1-9070-fa72c3775b0d service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:30.375546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-70bbc73f-33f8-42bc-80e1-e167b867e932 req-441e820d-5d28-49e1-9070-fa72c3775b0d service nova] Creating event network-vif-deleted:ba1d3b58-bb9d-46e0-829d-2efdeecd2e0c for instance 609cf815-b2a9-4258-82a9-29d7eded8012 on hv-cinder-75671 Sep 19 15:17:30.381869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-70bbc73f-33f8-42bc-80e1-e167b867e932 req-441e820d-5d28-49e1-9070-fa72c3775b0d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Sep 19 15:17:30.382475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 310/633] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:30.532044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:30.533009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:30.539483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.539998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.540657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:30.541367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.541823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.542248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:30.606191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:30.615463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b8e62156-20d0-490e-b669-7fb741fcefb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.087441 Sep 19 15:17:30.616045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 324/634] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:30 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:30.869410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:30.870131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:30.876808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.877375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.877821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:30.878538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:30.879005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:30.879436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:31.018702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:31.027656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e1e0dbb3-faae-4d44-bbef-e8a3e1736e9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.163950 Sep 19 15:17:31.028586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 311/635] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:31.638550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:31.639212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:31.645756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:31.646250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:31.646689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:31.647394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:31.647851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:31.648279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:31.712079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:31.720508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0d94c21e-13bf-43e8-b711-e02a3afaf353 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085219 Sep 19 15:17:31.721077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 325/636] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:31 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:32.052624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:32.053212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:32.059686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:32.060167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:32.060638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:32.061331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:32.061783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:32.062206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:32.198771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:32.207512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a87af94e-08aa-484e-a239-fbc678578ce6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.159062 Sep 19 15:17:32.208087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 312/637] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:32.744223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:32.744820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:32.751883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:32.752474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:32.753996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:32.754757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:32.755219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:32.755652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:32.816930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:32.824553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b783b844-7f27-4629-96fc-a21a6525bbee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084308 Sep 19 15:17:32.825114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 326/638] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:32 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:33.231477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:33.232092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:33.238816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:33.239311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:33.239748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:33.240443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:33.240932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:33.241360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:33.373648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:33.382069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-da816077-6591-4693-abe8-26839b0140dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154442 Sep 19 15:17:33.382637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 313/639] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:33.848254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:33.848890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:33.855226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:33.855686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:33.856117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:33.856832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:33.857280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:33.857695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:33.917768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:33.925924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b5657710-511f-4254-b5a1-e85ca7d7e000 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082252 Sep 19 15:17:33.926473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 327/640] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:33 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:34.405770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:34.406383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:34.413385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:34.413869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:34.414304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:34.415003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:34.415462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:34.415889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:34.551395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:34.559011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e83c3adb-4321-43d4-8f9c-5afc79350e50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157214 Sep 19 15:17:34.559569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 314/641] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:34.948590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:34.949197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:34.955541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:34.956012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:34.956441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:34.957138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:34.957584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:34.957996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:35.018433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:35.026110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1bb7e296-0df6-44c5-804e-423474c7f945 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081443 Sep 19 15:17:35.026660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 328/642] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:34 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:35.582598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:35.583214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:35.589655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:35.590139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:35.590575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:35.591265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:35.591721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:35.592148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:35.723784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:35.731627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c31365c2-d4eb-41d0-945f-7f5bfe1deb5c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153015 Sep 19 15:17:35.732194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 315/643] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:36.050000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:36.050512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:36.056913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:36.057393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:36.057829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:36.058521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:36.058977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:36.059401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:36.135072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:36.143305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d553bb4d-3390-4b6c-8a06-1505a2a1360d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.098024 Sep 19 15:17:36.143861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 329/644] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:36 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:36.757313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:36.757847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:36.763874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:36.764360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:36.764828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:36.765521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:36.765977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:36.766403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:36.896678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:36.904294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-041ce5fb-39b3-4b27-8e59-bb077d38fea7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151213 Sep 19 15:17:36.904892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 316/645] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:37.166769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:37.167350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:37.174033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:37.174509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:37.174939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:37.175620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:37.176062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:37.176508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:37.237120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:37.244740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-efdb0331-cde2-4091-9e25-888e2ae87ebe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081891 Sep 19 15:17:37.245294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 330/646] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:37 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:37.929192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:37.929837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:37.936233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:37.936749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:37.937187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:37.937879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:37.938336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:37.939339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:38.069116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:38.076756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4710669b-1f14-4ac5-87d4-338e9408ff9e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151418 Sep 19 15:17:38.077326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 317/647] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:38.267885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:38.268514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:38.274914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:38.275392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:38.275827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:38.276540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:38.277275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:38.277707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:38.280344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:38.339765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:38.348011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-548679c8-ff81-4782-afc7-232240344d4a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084153 Sep 19 15:17:38.348596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 331/648] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:38 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:39.100335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:39.100974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:39.107283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:39.107763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:39.108195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:39.109176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:39.109625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:39.110046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:39.239776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:39.247462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dae1be91-7354-4bfe-aeea-94afc041492d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150970 Sep 19 15:17:39.248023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 318/649] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:39.372165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:39.372745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:39.379459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:39.379938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:39.380377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:39.381113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:39.381571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:39.381999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:39.444075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:39.451968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ff74b9f1-1ce7-4f66-bcfb-99678add6c27 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084195 Sep 19 15:17:39.452615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 332/650] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:39 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:40.270582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:40.271228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:40.277694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:40.278179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:40.278664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:40.279352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:40.279810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:40.280234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:40.413721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:40.421388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cdf9c412-3672-47f4-b06c-ceca4baed959 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154811 Sep 19 15:17:40.421949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 319/651] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:40.476883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:40.477525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:40.484410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:40.484938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:40.485379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:40.486074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:40.486985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:40.486985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:40.548362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:40.556075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-db06633f-bc10-4a5a-b70a-14491895e625 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083074 Sep 19 15:17:40.558120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 333/652] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:40 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:41.445552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:41.446168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:41.452591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.453086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.453524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.454952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.455424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.455853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.472123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:41.579184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:41.579929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:41.586516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.587004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.587432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.588129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:41.588598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:41.589020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:41.599530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:41.607326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7be289c9-32d2-42e1-a9e5-0ca887716c22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.165697 Sep 19 15:17:41.607892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 320/653] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:41.651575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:41.660030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ca798814-72db-4553-9e5e-90a1562419d1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084755 Sep 19 15:17:41.660622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 334/654] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:41 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:42.631806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:42.632422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:42.639033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:42.639522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:42.639959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:42.640689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:42.641153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:42.641606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:42.682803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:42.683426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:42.690770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:42.691257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:42.691699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:42.692399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:42.692886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:42.693307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:42.763795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:42.771708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b04759ec-a269-4f20-b81b-465f7f9ef01a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.092698 Sep 19 15:17:42.779067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 335/655] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:42 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:42.796145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:42.804579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e4a356d1-8c5c-42cf-a077-1e9cbf3828ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.176736 Sep 19 15:17:42.805142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 321/656] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:43.795107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:43.795718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:43.805445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.805967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.806420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.807131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.807584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.808008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.827193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:43.827894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:43.834861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.835343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.835778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.836470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:43.836951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:43.837373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:43.881046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:43.889616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5031160e-f1f5-4d31-a4fd-f1501879e2a1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.098300 Sep 19 15:17:43.890833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 336/657] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:43 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:43.978094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:43.986823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-43e91f91-f28b-4584-b64e-b58641582dc1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.163551 Sep 19 15:17:43.987378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 322/658] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:44.913984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:44.914590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:44.920907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.921383 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.921809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.922492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:44.922937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:44.923350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:44.984462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:44.992349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-205e3180-9829-40e6-9e92-2e7905afdcb1 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082268 Sep 19 15:17:44.992942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 337/659] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:44 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:45.011026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:45.011644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:45.018683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.019169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.019612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.020309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.020800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.021231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.151935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:45.160277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-385aff6b-73dd-44c3-9328-12b574d6a169 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153068 Sep 19 15:17:45.160868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 323/660] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:45.567862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:45.568361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:45.574296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.574810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.575245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.575937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.576393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.576847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.599291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e41ab778-17d4-48d3-a594-11f5e413b899 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/ips" status: 200 len: 150 microversion: 2.1 time: 0.035985 Sep 19 15:17:45.599850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 338/661] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:17:45 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:17:45.613343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:17:45.615768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:45.621816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.622301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.622743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:45.623436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:45.623895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:45.624321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.015709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:46.017834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:46.024552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:46.025034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:46.025466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.026150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:46.026601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:46.027052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.088592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:46.096220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c6b63d20-7b68-4aa1-9034-385f93584a62 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084972 Sep 19 15:17:46.096933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 339/662] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:46 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:46.183371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:46.183984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:46.190716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:46.191193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:46.191624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.192496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:46.192959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:46.193379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:46.322506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:46.330434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f811cb88-7e09-4591-b32c-7df3b1f31152 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150820 Sep 19 15:17:46.330999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 340/663] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:47.119108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:47.119748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:47.126473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.129837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.129837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:47.129837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.129837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.130218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:47.193915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:47.201670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7811eb10-ae3b-4505-9a2d-838eda8e6183 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086531 Sep 19 15:17:47.202216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 341/664] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:47 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:47.353895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:47.354425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:47.361458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.361973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.362414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:47.363100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:47.363549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:47.363969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:47.498373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:47.506334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dfcd92ce-bc49-4f1d-bffe-b47b9a764ab1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156334 Sep 19 15:17:47.506892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 342/665] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:48.224365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:48.225069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:48.227333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:48.232140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:48.232695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:48.233137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:48.233833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:48.234708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:48.235733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:48.296581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:48.305529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c37aaf58-e335-41ba-8da0-7422c153dd82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085601 Sep 19 15:17:48.306087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 343/666] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:48 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:48.529701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:48.530308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:48.536842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:48.537327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:48.537758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:48.538440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:48.538917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:48.539338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:48.669665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:48.678067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-087777ed-7da6-40f9-a99d-db674b28d57b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152235 Sep 19 15:17:48.678627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 344/667] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:49.328418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:49.329803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:49.336572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.337062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.337500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.338196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.338654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.339078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.400238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:49.408656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5166b6fb-690c-4c72-b4be-d777a3695a88 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084097 Sep 19 15:17:49.409222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 345/668] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:49 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:49.701871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:49.702489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:49.708446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.708965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.709398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.710088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:49.710539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:49.711016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:49.841022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:49.849446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c0aa4312-1831-42b1-8b03-2341c3ebce98 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151509 Sep 19 15:17:49.850007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 346/669] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:50.431636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:50.432296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:50.439411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:50.439900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:50.440347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:50.441074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:50.441533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:50.441961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:50.506736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:50.514513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b027219b-dcee-4a06-9e57-eb580cc798aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086931 Sep 19 15:17:50.520343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 347/670] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:50 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:50.873442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:50.874087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:50.880735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:50.881217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:50.881649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:50.882335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:50.882783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:50.883201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:50.887083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:51.012404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:51.024944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0cf0a419-ee6e-4817-91c1-fb3a7d6375f9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155367 Sep 19 15:17:51.027239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 348/671] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:51.538910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:51.539580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:51.545918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:51.546392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:51.546825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:51.547511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:51.547989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:51.548407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:51.608666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:51.616707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-14e465c8-c743-45f3-a7a2-72310278c59b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081619 Sep 19 15:17:51.617262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 349/672] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:51 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:52.058913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:52.059520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:52.066184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:52.066659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:52.067210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:52.067889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:52.068337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:52.068785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:52.208025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:52.215736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5bd3cc5f-b06a-4dd8-81d9-81d128bef4c4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160651 Sep 19 15:17:52.216330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 350/673] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:52.639470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:52.640104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:52.646423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:52.646895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:52.647325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:52.648001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:52.648499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:52.648909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:52.711715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:52.719255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e0792269-37e6-47d4-8cc8-72ec98fde217 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083646 Sep 19 15:17:52.720344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 351/674] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:52 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:53.239537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:53.240150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:53.246101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:53.246578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:53.247044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:53.247731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:53.248182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:53.248647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:53.379431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:53.387012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2489d0aa-1d10-43ef-afe7-0dcb26e3b65c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151789 Sep 19 15:17:53.387560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 352/675] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:53.742184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:53.742839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:53.749278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:53.749756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:53.750189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:53.751577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:53.752032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:53.752450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:53.815928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:53.823517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3faba5a3-5594-47dd-b6ee-51e3dbde4701 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085212 Sep 19 15:17:53.824071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 353/676] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:53 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:54.411434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:54.412046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:54.417967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:54.418446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:54.418880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:54.419571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:54.420023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:54.420446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:54.552207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:54.560024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a3dee856-4f21-43c4-8231-21499ee7c0b4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153041 Sep 19 15:17:54.560606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 354/677] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:54.850915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:54.851616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:54.858437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:54.858919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:54.859613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:54.860348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:54.861073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:54.861850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:54.937373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:54.946297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fb02dc31-8094-44bc-b680-e9fa504a1d00 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.101449 Sep 19 15:17:54.946869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 355/678] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:54 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:55.582214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:55.582820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:55.588711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:55.589185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:55.589609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:55.590287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:55.590731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:55.591144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:55.619516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=43 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:55.642364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=25 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:17:55.725487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:55.733226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2b1a871c-6437-4b7a-8f4d-0c8f11d2a3dc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154926 Sep 19 15:17:55.733796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 356/679] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:55.973937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:55.974571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:55.980829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:55.981315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:55.981749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:55.982432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:55.982882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:55.983299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:56.046583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:56.054525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-692bf046-01f2-41e2-9631-f832a52639c5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085306 Sep 19 15:17:56.055087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 357/680] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:55 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:56.756541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:56.757158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:56.763467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:56.763961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:56.764398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:56.765134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:56.765589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:56.766027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:56.899091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:56.907195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9440b368-1489-416f-9992-0e34c38ebc9f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154607 Sep 19 15:17:56.907877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 358/681] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:57.079660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:57.080353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:57.099295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:57.099778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:57.100212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:57.100942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:57.101401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:57.101822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:57.169854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:57.178235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ffa20376-b856-4539-b038-ab45373c3206 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.105351 Sep 19 15:17:57.178786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 359/682] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:57 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:57.930873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:57.931467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:57.937342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:57.937904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:57.938769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:57.939450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:57.939897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:57.940314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:58.304921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:58.312675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1d986baf-164e-403e-a25a-30bc5ce62ba9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.385644 Sep 19 15:17:58.313818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 360/683] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:58.318325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:58.318931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:58.324408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:58.324921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:58.325362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:58.326051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:58.326505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:58.326928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:58.387910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:58.395613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-53b3520c-e19c-40de-aa2c-fe4f25fd30ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080744 Sep 19 15:17:58.396173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 361/684] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:58 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:17:59.335534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:59.336208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:59.342615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:59.343105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:59.343541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:59.344235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:59.345541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:59.346066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:59.478570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:59.487637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a7a5a722-0b9b-4608-885a-d2dee41fe09a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155959 Sep 19 15:17:59.488199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 362/685] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:17:59.492674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:17:59.493164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:17:59.498670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:59.499149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:59.499583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:59.500265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:17:59.500820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:17:59.501560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:17:59.565348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:17:59.573249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c197701d-0211-4e6b-90b1-50d002be10bc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084054 Sep 19 15:17:59.573817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 363/686] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:17:59 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:00.511336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:00.511955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:00.518862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:00.522416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:00.522416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:00.522416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:00.522416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:00.522803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:00.652169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:00.654478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:00.660724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9a02a0ff-88a9-4dbc-80a4-1d4b9e797c65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153345 Sep 19 15:18:00.661286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 364/687] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:00.665655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:00.666258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:00.671838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:00.672318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:00.673314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:00.674005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:00.674496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:00.674919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:00.740967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:00.748717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-edb6dbf1-3da1-4e6e-bdcd-77de92ed0fdd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086393 Sep 19 15:18:00.749220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 365/688] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:00 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:01.684278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:01.684998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:01.691339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:01.691821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:01.692246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:01.692953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:01.693398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:01.693811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:01.823673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:01.831504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ee41f16e-cc0d-499f-850a-d139949a472d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151148 Sep 19 15:18:01.832062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 366/689] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:01.836350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:01.836975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:01.842319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:01.842795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:01.843229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:01.843912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:01.844902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:01.845319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:01.908055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:01.915719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d207e532-e32e-4f7f-b5d8-49ec0ed08ae0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082695 Sep 19 15:18:01.916275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 367/690] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:01 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:02.855175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:02.855817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:02.862678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:02.863161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:02.863592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:02.864276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:02.864758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:02.865179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:02.998280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:03.006684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6137e866-23d8-4abb-b2e4-a7355de6c03b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155376 Sep 19 15:18:03.007243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 368/691] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:03.011604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:03.012205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:03.018389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:03.018865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:03.019299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:03.019990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:03.020444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:03.020897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:03.081128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:03.088766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8cfd272d-b9cd-43a6-8897-0b88aa971554 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080556 Sep 19 15:18:03.089327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 369/692] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:03 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:04.031087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:04.031699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:04.038877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:04.039365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:04.039803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:04.040514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:04.040976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:04.041401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:04.170583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:04.178924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0ffd752-7ae3-4a33-b5e5-a79426155b53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151942 Sep 19 15:18:04.179488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 370/693] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:04.183950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:04.184580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:04.190386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:04.190874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:04.191314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:04.192008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:04.192463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:04.192912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:04.257215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:04.264949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-95b8b71f-1300-4e9d-bc44-2bb4ecf03aa3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084476 Sep 19 15:18:04.265511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 371/694] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:04 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:05.201848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:05.202514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:05.209034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:05.209517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:05.209957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:05.210650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:05.211106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:05.211536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:05.342166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:05.350692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d6b9b2aa-a463-4cb9-8469-0c17fb26ea57 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152794 Sep 19 15:18:05.351253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 372/695] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:05.355603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:05.356204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:05.362594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:05.363075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:05.363512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:05.364206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:05.364693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:05.365114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:05.426705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:05.434334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-52ceebc9-f645-4a71-89bc-e1559b7d107f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082137 Sep 19 15:18:05.434905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 373/696] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:05 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:06.375256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:06.376540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:06.382564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:06.383040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:06.383469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:06.384143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:06.384614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:06.385031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:06.521489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:06.529292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0419b184-2bce-4ef2-bbf5-5b883eea3595 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158006 Sep 19 15:18:06.529859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 374/697] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:06.534396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:06.534999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:06.540546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:06.541033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:06.541467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:06.542161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:06.542613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:06.543039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:06.603455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:06.612503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4e18298c-9e2a-49b7-a983-2122cefb8b0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081678 Sep 19 15:18:06.613059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 375/698] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:06 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:07.552805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:07.553482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:07.559844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:07.560321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:07.560789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:07.561477 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:07.561926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:07.562352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:07.693173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:07.700803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aa2a2dd8-7fe7-410d-9813-5d55a774611e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152050 Sep 19 15:18:07.701366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 376/699] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:07.706576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:07.707180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:07.712643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:07.713126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:07.713555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:07.714240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:07.714695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:07.715115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:07.783574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:07.791239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-045d4297-0c79-4f51-8b64-0b629767ddb2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.088923 Sep 19 15:18:07.791794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 377/700] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:07 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:08.724962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:08.725686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:08.731999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:08.732504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:08.732943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:08.733633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:08.734087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:08.734773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:08.870594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:08.878384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-905a12c7-8844-4402-97d6-c56252a59b1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157967 Sep 19 15:18:08.878945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 378/701] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:08.883362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:08.883965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:08.889566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:08.890044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:08.890473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:08.891155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:08.891601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:08.892626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:08.952332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:08.960600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f14ebdca-3d16-4a69-b94a-7fe7b37188e6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080701 Sep 19 15:18:08.961159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 379/702] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:08 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:09.902064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:09.902682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:09.909528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:09.910009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:09.910445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:09.911141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:09.911595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:09.912021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:10.046122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:10.053988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-83f37ed4-023d-49fe-91e0-6951ebc8ca2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155792 Sep 19 15:18:10.054549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 380/703] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:10.058886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:10.059487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:10.065838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:10.066329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:10.066767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:10.067459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:10.067916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:10.068340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:10.083509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:10.130921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:10.138409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e35a3e0d-c424-4589-aaa9-7ee54d1074a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082927 Sep 19 15:18:10.138971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 381/704] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:10 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:11.077660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:11.078320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:11.085817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:11.086295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:11.086725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:11.087441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:11.087892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:11.088311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:11.219247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:11.228249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c0da2df-7023-4a8c-af34-7f37b0620c51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154467 Sep 19 15:18:11.228857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 382/705] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:11.233263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:11.233862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:11.240469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:11.240977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:11.241412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:11.242162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:11.242659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:11.243082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:11.310246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:11.319110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4f478175-f8ba-481f-99ec-dc370c8ef90a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.089293 Sep 19 15:18:11.319670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 383/706] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:11 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:12.252677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:12.253302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:12.260145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:12.260665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:12.261100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:12.261789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:12.262239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:12.262660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:12.396434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:12.404360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-be3dd4cf-cb33-4ec9-af49-b3efd3e4adc4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156536 Sep 19 15:18:12.404989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 384/707] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:12.409549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:12.410148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:12.415724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:12.416205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:12.416684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:12.417378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:12.417836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:12.418256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:12.479344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:12.487385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5bb2dd06-b6cf-462c-9946-55179cb2677f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081445 Sep 19 15:18:12.487991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 385/708] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:12 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:13.428432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:13.429112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:13.435496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:13.435980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:13.436417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:13.437139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:13.437591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:13.438012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:13.574028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:13.582358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-54971c55-052a-40b3-9826-04ef86f340ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157814 Sep 19 15:18:13.582926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 386/709] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:13.587367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:13.587970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:13.593720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:13.594204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:13.594645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:13.595424 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:13.595972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:13.596401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:13.657001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:13.664806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-88fa000a-b17c-47b4-a192-a1cddd850958 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080908 Sep 19 15:18:13.665366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 387/710] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:13 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:14.605760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:14.606369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:14.613787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:14.614274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:14.614711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:14.615404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:14.615856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:14.616278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:14.751624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:14.753552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-866e9eea-59c2-4609-aebd-6b19b54bbe44 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151593 Sep 19 15:18:14.754066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 388/711] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:14.758439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:14.759034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:14.764815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:14.765283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:14.765710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:14.766393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:14.766842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:14.767766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:14.833409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:14.841099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0c9c3e6-23ba-4eb1-a8b7-957eb0b40955 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086082 Sep 19 15:18:14.841653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 389/712] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:14 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:15.777226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:15.777876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:15.784900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:15.785380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:15.785809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:15.786495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:15.786944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:15.787366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:15.916718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:15.925149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d3530191-a703-484a-90f3-d5220df03dd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151855 Sep 19 15:18:15.925703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 390/713] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:15.930220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:15.930813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:15.936500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:15.937005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:15.937444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:15.938146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:15.938632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:15.939199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:15.999902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:16.007743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7f872ace-32e2-46a2-a680-e9bbc8e2248e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081103 Sep 19 15:18:16.008305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 391/714] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:15 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:16.949445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:16.950032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:16.956413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:16.956925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:16.957359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:16.958053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:16.958507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:16.958933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:17.093273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:17.101201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-08259d64-1c8c-4660-8f53-9a1d04f53c73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155715 Sep 19 15:18:17.101767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 392/715] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:17.106153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:17.106753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:17.108322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:17.113604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:17.114086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:17.114519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:17.115217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:17.115669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:17.116098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:17.177086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:17.184695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-376af833-d0fa-475e-81a1-76bd069c49e2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081949 Sep 19 15:18:17.185258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 393/716] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:17 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:18.125157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:18.125802 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:18.132859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:18.133341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:18.133772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:18.134465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:18.134915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:18.135341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:18.270572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:18.278324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-abdecd7f-3b2e-49f6-a78c-3fbbfc392aa2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157030 Sep 19 15:18:18.278886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 394/717] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:18.283210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:18.283830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:18.289266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:18.289747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:18.290184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:18.290871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:18.291326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:18.291752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:18.356399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:18.365198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-07a9d5eb-07e0-4a65-9d83-2e9ff35e8197 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085360 Sep 19 15:18:18.365753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 395/718] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:18 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:19.301376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:19.302035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:19.308350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:19.308852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:19.309283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:19.309971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:19.310417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:19.310925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:19.442294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:19.450027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-245bcb45-b764-4fcb-b1ad-8d68e5205da3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152581 Sep 19 15:18:19.450588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 396/719] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:19.455065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:19.456169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:19.461737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:19.475979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:19.475979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:19.475979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:19.475979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:19.476358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:19.526880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:19.534888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-da4a68f1-e525-4e6c-91fc-f867299958c2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083351 Sep 19 15:18:19.535441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 397/720] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:19 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:20.474080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:20.474769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:20.481131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:20.481607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:20.482039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:20.482770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:20.483212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:20.483628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:20.486401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:20.619874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:20.627655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fd641017-2cc9-4933-b92e-002d128fe7b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157947 Sep 19 15:18:20.628369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 398/721] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:20.632830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:20.633427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:20.639521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:20.641394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:20.641394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:20.641394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:20.641857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:20.641951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:20.704159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:20.712466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-756fb4b3-73ac-4af8-a1d7-e3ebc4f5ce0f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083141 Sep 19 15:18:20.713036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 399/722] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:20 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:21.651217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:21.651848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:21.658639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.659192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.659623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.660306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.660849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.661217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.797267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:21.805726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c9e72fdd-8b9e-4f11-8bdb-f8d2d01621c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158449 Sep 19 15:18:21.806337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 400/723] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:21.810823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:21.811433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:21.818481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.818977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.819415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.820117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:21.820601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:21.821027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:21.885796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:21.893652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e04fff13-f267-46ff-ace3-cdc08289b80a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086296 Sep 19 15:18:21.894228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 401/724] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:21 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:22.829316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:22.829984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:22.837412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.837900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.838343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:22.839039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.839495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.839920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:22.971475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:22.979214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6b6c1219-a02d-431f-96e0-ca24fd508612 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153749 Sep 19 15:18:22.979782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 402/725] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:22.984220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:22.985116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:22.991392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.991875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.992310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:22.993051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:22.993508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:22.993929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:23.053681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:23.061310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-18fc1eec-4ba2-4978-97df-8ed3288a458e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080548 Sep 19 15:18:23.061857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 403/726] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:22 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:24.003874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:24.004549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:24.010905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.011382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.011808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.012498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.012965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.013382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.147137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:24.154757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cf140836-fa9f-4625-8a20-35949d70b2b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155457 Sep 19 15:18:24.155317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 404/727] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:24.159638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:24.160240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:24.165662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.166142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.166579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.167268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:24.167719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:24.168162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:24.228374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:24.236345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0af5ee4a-69f4-4fc8-94de-1b6e404830d2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080087 Sep 19 15:18:24.236965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 405/728] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:24 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:25.178603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:25.179275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:25.185604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:25.186080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:25.186508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:25.187189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:25.187633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:25.188048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:25.318970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:25.326635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-82993657-37c1-4500-aacb-287c2b2ae2ac tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152425 Sep 19 15:18:25.327196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 406/729] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:25.331779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:25.332378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:25.338007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:25.338481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:25.338909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:25.339595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:25.340046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:25.340471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:25.405079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:25.412824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-313bb08d-9e81-4317-9dc5-d8ee36d4c97d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084533 Sep 19 15:18:25.413384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 407/730] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:25 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:26.349832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:26.350474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:26.357030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:26.357516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:26.358272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:26.358973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:26.359427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:26.360112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:26.495364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:26.503613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-267d642d-c0c8-4896-9a8d-56e0333f87a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157594 Sep 19 15:18:26.504187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 408/731] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:26.508807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:26.509298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:26.515335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:26.515828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:26.516265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:26.516987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:26.517440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:26.518015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:26.579943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:26.588557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2080cf59-1120-4f0f-95c0-517dd304280f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083325 Sep 19 15:18:26.589127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 409/732] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:26 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:27.526789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:27.527455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:27.535031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:27.535504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:27.535945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:27.536692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:27.537147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:27.538905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:27.676356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:27.683989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cb9fc00c-7a35-4820-923b-3538254504f7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.161189 Sep 19 15:18:27.684579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 410/733] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:27.688893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:27.689493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:27.695776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:27.696250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:27.696715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:27.697400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:27.697848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:27.698266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:27.759557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:27.767390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-063ccdbd-6d76-4863-b2c7-ed4df2245f5b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081882 Sep 19 15:18:27.768168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 411/734] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:27 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:28.707248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:28.707893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:28.714256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:28.714748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:28.715159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:28.715837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:28.716280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:28.716724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:28.848774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:28.856552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9a4cfd69-2dfa-4802-94f5-10f5a547484a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153212 Sep 19 15:18:28.857114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 412/735] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:28.862512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:28.863108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:28.868832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:28.869318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:28.869874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:28.870566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:28.871018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:28.871440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:28.936074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:28.944325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f3cfc6e6-0dc9-401b-b5c0-4b68a0b994e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086270 Sep 19 15:18:28.944907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 413/736] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:28 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:29.880374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:29.880998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:29.887390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:29.887865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:29.888295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:29.889008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:29.889455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:29.889872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:30.021490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:30.023671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:30.030041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1a217e7a-f64f-471d-b56f-66ec0681c328 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153477 Sep 19 15:18:30.030550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 414/737] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:30.035090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:30.035695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:30.041317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:30.041801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:30.042235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:30.042926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:30.043382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:30.043809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:30.105922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:30.114060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3adf5007-b2e7-478f-968a-332269c72499 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082548 Sep 19 15:18:30.114650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 415/738] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:30 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:31.054386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:31.055044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:31.061327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:31.061801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:31.062237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:31.062917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:31.063362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:31.063779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:31.198309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:31.206925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-030245df-3765-49cb-9fae-beb4e5b1b3a0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156492 Sep 19 15:18:31.207489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 416/739] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:31.211797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:31.212394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:31.217839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:31.218314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:31.218749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:31.219426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:31.219876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:31.220298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:31.281411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:31.289371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7f0293c5-632b-42be-8dd6-2e6dab00c20e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080942 Sep 19 15:18:31.289945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 417/740] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:31 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:32.230843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:32.231499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:32.238390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:32.241127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:32.241127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:32.241127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:32.241127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:32.241485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:32.375988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:32.384577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-61d11c0b-1ec8-4337-b8a4-798720b6dd10 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157599 Sep 19 15:18:32.385136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 418/741] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:32.389613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:32.390290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:32.396404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:32.396914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:32.397345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:32.398030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:32.398478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:32.398896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:32.463067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:32.470994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e3ad6915-f8f0-476c-81ad-2657ae84b715 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084836 Sep 19 15:18:32.471580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 419/742] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:32 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:33.408054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:33.408773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:33.415253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:33.415734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:33.416170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:33.416935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:33.417397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:33.417823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:33.550741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:33.558461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3ce57077-a42e-41ad-a063-52ccf3cd32be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154252 Sep 19 15:18:33.559011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 420/743] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:33.563382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:33.563976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:33.570256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:33.570734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:33.571159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:33.571845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:33.572290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:33.572732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:33.633327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:33.640899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8bfd85d1-14d0-4462-8b19-0fd68ed66154 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080931 Sep 19 15:18:33.641448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 421/744] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:33 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:34.583041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:34.583663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:34.590107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:34.590582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:34.591012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:34.591696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:34.592153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:34.592601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:34.735660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:34.743609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-74e75173-f920-41c5-b56a-3cfebd30a016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.165165 Sep 19 15:18:34.744182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 422/745] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:34.748916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:34.749526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:34.756050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:34.756557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:34.756992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:34.757684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:34.758139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:34.758556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:34.820532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:34.828201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c4196162-f7bb-4454-bb64-ed31f49c6b86 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083044 Sep 19 15:18:34.828807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 423/746] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:34 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:35.767309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:35.767968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:35.774974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:35.775451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:35.775884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:35.776607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:35.777063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:35.777485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:35.908558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:35.916331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ccdada57-c450-4b02-b8aa-09a7fb394c5f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152893 Sep 19 15:18:35.916921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 424/747] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:35.921336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:35.921939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:35.927879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:35.928360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:35.928822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:35.929523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:35.929975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:35.930402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:35.994604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:36.002214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-15eb2c51-1f9a-4b5c-891c-e4f612a8d849 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084357 Sep 19 15:18:36.002770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 425/748] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:35 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:36.939865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:36.941178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:36.947243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.947727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.948166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:36.948888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:36.949345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:36.949768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:37.077403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:37.085703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e304fff9-7d2c-4bbb-ab60-968f742dee1e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.149705 Sep 19 15:18:37.086280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 426/749] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:37.090996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:37.091609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:37.101551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:37.102041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:37.102483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:37.103185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:37.103644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:37.104071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:37.170261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:37.178549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-54e3d201-28fd-4dcf-ac4d-0db44e62bbc3 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.091313 Sep 19 15:18:37.179116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 427/750] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:37 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:38.111134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:38.111784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:38.118254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.118737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.119174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.119867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.120320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.120776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.254865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:38.262625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-93c0d41f-9afc-4f81-9384-cafe15a4638b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155648 Sep 19 15:18:38.263187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 428/751] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:38.267516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:38.268119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:38.273525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.274014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.274469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.275149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:38.275603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:38.276027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:38.337957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:38.347235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4c357402-ed4c-4cf0-bcd6-a1ad727761f7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082237 Sep 19 15:18:38.347864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 429/752] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:38 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:39.285147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:39.286012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:39.292218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.292741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.293180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.293879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.294333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.294754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.424134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:39.432338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4cddd89a-bbe3-49f8-b5fb-6143233b51be tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151289 Sep 19 15:18:39.432921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 430/753] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:39.437326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:39.437918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:39.444194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.444698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.445139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.445871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:39.446355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:39.446786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:39.463330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:39.511897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:39.519588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-11da1b05-ac58-488d-8234-842746099211 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085727 Sep 19 15:18:39.520153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 431/754] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:39 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:40.456665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:40.457573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:40.463729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:40.464212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:40.464676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.465367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:40.465822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:40.466245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.598497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:40.606303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0113ce5e-c2b4-4750-90a0-1ee315a0a540 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154544 Sep 19 15:18:40.606861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 432/755] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:40.611488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:40.612117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:40.617681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:40.618151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:40.618579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.619260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:40.619703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:40.620114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:40.680358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:40.687905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fa85f7a0-561c-4cfd-bc31-30f0ce88c0fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080117 Sep 19 15:18:40.688463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 433/756] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:40 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:41.632299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:41.633033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:41.639355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.639824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.640248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.640968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.641400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.641815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.775439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:41.783166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3bdd9bcf-a975-4832-8b01-04a9e3415aaa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155697 Sep 19 15:18:41.783754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 434/757] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:41.788132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:41.788754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:41.794136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.794601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.795024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.795699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:41.796143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:41.796580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:41.856055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:41.864370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ab97718b-1ed1-4a56-aa37-eab1d2a1401a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.079647 Sep 19 15:18:41.864958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 435/758] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:41 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:42.806388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:42.807375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:42.813826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.814321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.814760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:42.815996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.816458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.816907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:42.949161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:42.957784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-50b05db3-8e4a-44e3-aec2-cb445d4d51b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155285 Sep 19 15:18:42.958354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 436/759] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:42.962697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:42.963295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:42.968895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.969380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.969819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:42.970519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:42.971022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:42.971478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.035245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:43.042971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-50103a1d-c1b6-4d47-8194-4d2023bf4dd2 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083685 Sep 19 15:18:43.043530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 437/760] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:42 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:43.980331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:43.987896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:43.987896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:43.988311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:43.988766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:43.989464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:43.989904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:43.990320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:44.126493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:44.134827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9dae4ccc-efdf-4918-92a1-572345907aed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158364 Sep 19 15:18:44.135467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 438/761] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:44.139963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:44.140811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:44.147455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:44.148011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:44.148563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:44.149515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:44.150086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:44.150560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:44.215229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:44.223503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-de6b68fb-9a63-4934-8679-82f4bd52b994 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.087022 Sep 19 15:18:44.224055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 439/762] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:44 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:45.160123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:45.160801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:45.167271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.167746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.168176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.168889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.169343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.169762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.302133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:45.309856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-17d5d03c-1301-480d-bef8-d1a28557bdcd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154797 Sep 19 15:18:45.310415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 440/763] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:45.314725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:45.315387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:45.320996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.321473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.321903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.322585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.323035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.323454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.383436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:45.391062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6ed8bd21-32e7-4be4-988d-90062c9d68e9 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.079711 Sep 19 15:18:45.391620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 441/764] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:45 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:45.683204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:45.683701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:45.689886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.690888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.691329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.692021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.692507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.692925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.717700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:18:45.904630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:45.968307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bc2af336-3e41-4b52-9805-127ebbd3d0fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 204 len: 0 microversion: 2.1 time: 0.288615 Sep 19 15:18:45.968927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 442/765] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:18:45 2022] DELETE /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:18:45.977410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:45.978121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:45.984039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.984501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.985207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:45.985894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:45.986353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:45.986774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.118695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:46.126346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4ded09c9-b2db-4f5c-abc6-1a9f8e7e5a63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1678 microversion: 2.1 time: 0.152796 Sep 19 15:18:46.126956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 443/766] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:45 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:46.333749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:46.334491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:46.340851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:46.344785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:46.344785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.344785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:46.344785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:46.345169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.481928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:46.490660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-935d1af9-8082-4df0-a842-e46e2be99db8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.161361 Sep 19 15:18:46.491229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 444/767] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:46.495558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:46.496160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:46.501543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:46.502026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:46.502460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.503436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:46.503779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:46.504204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:46.565057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:46.572818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62ad60e7-e72f-441e-866e-f662c2ad7367 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080628 Sep 19 15:18:46.573386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 445/768] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:46 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:47.150686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:47.153369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:47.157493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.157973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.158409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.159796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.160254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.160710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.175382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:47.287773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:47.295461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-640fe706-cef0-41ce-8a18-38f7a41b4e43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1678 microversion: 2.1 time: 0.148668 Sep 19 15:18:47.296942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 446/769] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:47 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:47.513938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:47.514568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:47.520944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.521423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.521862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.522544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.522992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.523410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.656153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:47.664570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3f9f8c5f-563e-472d-a073-b3d963a49418 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154678 Sep 19 15:18:47.665133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 447/770] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:47.669561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:47.670168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:47.675794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.676273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.676737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.677431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:47.677885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:47.678311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:47.739615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:47.747344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4c36841d-b873-4ead-a81c-163a0f49dd0a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081241 Sep 19 15:18:47.748097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 448/771] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:47 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:48.319414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:48.320023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:48.325949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.326430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.326863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.327547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.327994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.328412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.843445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:48.852440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b265f715-01eb-4a9a-8bbc-5b9db4f5c4f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1678 microversion: 2.1 time: 0.537018 Sep 19 15:18:48.853032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 449/772] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:48 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1678 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:48.857673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:48.858277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:48.865068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.865561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.865998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:48.866708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:48.867163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:48.867589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.087604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:49.103883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-56f7bac6-0960-4967-b509-f4a8d52e884b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.249790 Sep 19 15:18:49.104851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 450/773] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:49.109501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:49.110384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:49.122732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.123291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.123654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.124394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.124855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.125287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.215921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:49.223980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8fed1579-fb58-48a6-93ff-353a7bcca74d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.118247 Sep 19 15:18:49.224579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 451/774] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:49 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:49.394051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-cf21dd40-6492-4d3d-a390-cfa65ff57f49 req-e24e15fb-bde0-42b6-9312-a551954a3c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472c71ee-5670-4562-bfac-24f97b292419", "name": "network-vif-deleted", "tag": "e8833669-37bc-41f4-94f2-f7306e2ebdf0"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:18:49.404202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-cf21dd40-6492-4d3d-a390-cfa65ff57f49 req-e24e15fb-bde0-42b6-9312-a551954a3c88 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.404995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-cf21dd40-6492-4d3d-a390-cfa65ff57f49 req-e24e15fb-bde0-42b6-9312-a551954a3c88 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.405422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-cf21dd40-6492-4d3d-a390-cfa65ff57f49 req-e24e15fb-bde0-42b6-9312-a551954a3c88 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.418043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-cf21dd40-6492-4d3d-a390-cfa65ff57f49 req-e24e15fb-bde0-42b6-9312-a551954a3c88 service nova] Creating event network-vif-deleted:e8833669-37bc-41f4-94f2-f7306e2ebdf0 for instance 472c71ee-5670-4562-bfac-24f97b292419 on hv-cinder-75671 Sep 19 15:18:49.423251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-cf21dd40-6492-4d3d-a390-cfa65ff57f49 req-e24e15fb-bde0-42b6-9312-a551954a3c88 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033918 Sep 19 15:18:49.423843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 452/775] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:18:49.883303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:49.883303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:49.887377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.888093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.888633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.890979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.890979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.890979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.927965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:49.928837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:49.929161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:49.929521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'fault' on Instance uuid 472c71ee-5670-4562-bfac-24f97b292419 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:18:49.977581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:49.988269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ce220edd-78d2-4055-a871-570a22394e99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 200 len: 1330 microversion: 2.1 time: 0.112079 Sep 19 15:18:49.989359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 453/776] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:49 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:50.134231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:50.134747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:50.140505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:50.140986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:50.141415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:50.142095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:50.142544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:50.142958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:50.277990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:50.287242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-34eadf11-d955-48e1-b3e8-fc5dd7e4ad15 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157133 Sep 19 15:18:50.287800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 454/777] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:50.302584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:50.303192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:50.309084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:50.309558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:50.309985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:50.310665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:50.311111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:50.311526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:50.380881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:50.388960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ed379237-bd6a-4839-97a9-440eaca0ef1a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.090177 Sep 19 15:18:50.389528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 455/778] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:50 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:51.011374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:51.012006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:51.018485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:51.019061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:51.019523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:51.020248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:51.020729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:51.021162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 HTTP/1.1 Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:18:51.039232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:18:51.041007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '472c71ee-5670-4562-bfac-24f97b292419'} Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:18:51.041834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:18:51.043326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:18:51.044675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:18:51.044675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fd060245-1972-4ca6-b081-f9da04337a13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 404 len: 111 microversion: 2.1 time: 0.031023 Sep 19 15:18:51.044675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 456/779] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:51 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:18:51.050234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0478d80b-2f3d-429f-8a39-b463d1e45eaa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '.version_select at 0x7f41fecb6f70>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:51.055015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0478d80b-2f3d-429f-8a39-b463d1e45eaa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [a2b469f1-1f05-4f8e-8021-d22aaa378b1f] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:18:52.061372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [None req-0478d80b-2f3d-429f-8a39-b463d1e45eaa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [a2b469f1-1f05-4f8e-8021-d22aaa378b1f] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 49704. Sep 19 15:18:52.163800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0478d80b-2f3d-429f-8a39-b463d1e45eaa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248631217" status: 202 len: 0 microversion: 2.1 time: 1.117726 Sep 19 15:18:52.164402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 457/780] 10.222.0.75 () {58 vars in 1218 bytes} [Mon Sep 19 15:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248631217 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:18:52.171003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:52.171003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:52.176265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:52.176776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:52.177327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:52.177970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:52.178426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:52.178851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:52.361109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:52.369239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c2f101bb-2170-4798-90d7-e3c2c52b4be6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.203841 Sep 19 15:18:52.372689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 458/781] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:52.374441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:52.375047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:52.380759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:52.384377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:52.384377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:52.384377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:52.384377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:52.384822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:52.454047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:52.462725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-40a3a9a6-909f-4491-90af-c3313af96793 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.091811 Sep 19 15:18:52.463468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 459/782] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:52 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:53.392665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:53.394037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:53.400651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:53.401133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:53.401565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:53.402252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:53.402699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:53.403117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:53.534304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:53.542024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-29febb82-18c0-4ca6-8dc4-bcd770d9ec43 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153333 Sep 19 15:18:53.542584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 460/783] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:53.546931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:53.547532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:53.553639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:53.554128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:53.554563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:53.555251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:53.555706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:53.556130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:53.617405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:53.625080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ea62ea48-4d7e-46a5-864c-092c6c038d82 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081553 Sep 19 15:18:53.625641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 461/784] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:53 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:54.565489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:54.566084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:54.572692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:54.573172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:54.573605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:54.574294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:54.574749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:54.575171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:54.710772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:54.718452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b05ef30-ab9a-4b8d-bac1-7d9e7b2757eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156836 Sep 19 15:18:54.719013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 462/785] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:54.724194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:54.724817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:54.730221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:54.730700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:54.731128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:54.731813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:54.732261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:54.732710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:54.802203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:54.815091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-81aa10e2-e890-4756-897f-8d4b49e1bfbf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.095068 Sep 19 15:18:54.815759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 463/786] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:54 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:55.742393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:55.743083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:55.749399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:55.749876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:55.750302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:55.750992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:55.751434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:55.751851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:55.886324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:55.900980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-63da5cdb-48c1-40d1-a531-84e8ae5dc154 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.162540 Sep 19 15:18:55.901947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 464/787] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:55.912088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:55.913253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:55.920917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:55.921391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:55.921817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:55.922525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:55.922969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:55.923408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:55.927554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:18:55.989674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:55.997398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-640fb13e-5374-426d-a35e-12475f4c64bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.093486 Sep 19 15:18:55.997901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 465/788] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:55 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:56.932945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:56.933549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:56.940683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:56.941238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:56.941673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:56.942364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:56.942819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:56.943243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:57.075861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:57.083679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f1643c4a-2f05-492f-a213-53ded3d00893 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154869 Sep 19 15:18:57.084243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 466/789] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:57.088661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:57.089265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:57.094690 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:57.095205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:57.095651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:57.097009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:57.097475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:57.097903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:57.160230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:57.167169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bc723f40-c2e5-477a-8611-378a7fc36c69 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081892 Sep 19 15:18:57.167736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 467/790] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:57 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:58.107749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:58.108431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:58.115674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:58.116158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:58.116629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:58.117322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:58.117782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:58.118203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:58.252466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:58.260768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0778db60-5c71-4886-90dc-c881de6d2574 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156886 Sep 19 15:18:58.261325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 468/791] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:58.265655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:58.266253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:58.271728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:58.272203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:58.272664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:58.273364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:58.273805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:58.274243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:58.334657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:58.342188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e77e7c61-f316-495e-b2b9-98fc976a3905 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.079921 Sep 19 15:18:58.342748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 469/792] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:58 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:18:59.283575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:59.284390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:59.290745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:59.291216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:59.291643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:59.292319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:59.292791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:59.293209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:59.427259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:59.434998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8d186590-ee41-4933-8cc8-443c07a156c5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155299 Sep 19 15:18:59.435551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 470/793] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:18:59.439842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:18:59.440980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:18:59.446545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:59.447024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:59.447451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:59.448127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:18:59.448605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:18:59.449025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:18:59.514581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:18:59.523169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cf46158b-8540-41a2-a0d7-eadca65a7d50 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086655 Sep 19 15:18:59.523733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 471/794] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:18:59 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:00.458775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:00.459255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:00.465991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:00.469400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:00.469400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:00.469400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:00.469400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:00.469829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:00.597891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:00.605711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c93dd4db-d922-4f0d-9cbc-cfb939d39aa5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151890 Sep 19 15:19:00.606273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 472/795] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:00.610958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:00.616734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:00.617692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:00.618174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:00.618607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:00.619295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:00.619746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:00.620168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:00.681881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:00.689602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-150852b4-6abb-48c2-b10a-9ae3bb6ec6d6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082390 Sep 19 15:19:00.690776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 473/796] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:00 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:01.630178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:01.630815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:01.637201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:01.637677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:01.638110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:01.638787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:01.639233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:01.639652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:01.776362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:01.784101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-104058c4-9ff2-4c72-a1d2-f34583240cad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158275 Sep 19 15:19:01.784676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 474/797] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:01.788999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:01.789593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:01.795037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:01.795511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:01.795942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:01.796651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:01.797102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:01.797525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:01.857287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:01.865523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3d1aba1b-13b3-45bb-9937-3b8f71b39827 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.079919 Sep 19 15:19:01.866075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 475/798] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:01 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:02.807088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:02.807737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:02.814263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:02.814749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:02.815843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:02.816691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:02.817134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:02.817560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:02.945993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:02.953601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7cf50d42-c970-4910-a835-bc53bd385043 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150377 Sep 19 15:19:02.954155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 476/799] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:02.958706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:02.959296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:02.964694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:02.965233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:02.965701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:02.966386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:02.966827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:02.967243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:03.032788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:03.041098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d56e3f94-f3be-4c97-b469-cb74644b6d32 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086011 Sep 19 15:19:03.041647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 477/800] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:02 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:03.700668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:19:03.701294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/os-volume_attachments (ip 10.222.0.75) !!! Sep 19 15:19:03.977629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:03.978205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:03.984720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:03.985466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:03.985915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:03.986606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:03.987136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:03.987492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:04.122287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:04.130790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-877da0f9-b43c-4323-9aaf-dffe55029352 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157148 Sep 19 15:19:04.131358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 478/801] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:04.135809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:04.136409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:04.141886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:04.142368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:04.142800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:04.143492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:04.143949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:04.144374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:04.205521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:04.213404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bb7e1fcc-6f6f-4e67-971d-43f3949b881f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081104 Sep 19 15:19:04.213962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 479/802] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:04 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:05.153876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:05.154562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:05.162030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:05.162493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:05.162925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:05.163608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:05.164060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:05.164501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:05.297999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:05.305934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-086c8da3-ee60-4cf9-98be-70882519e204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155900 Sep 19 15:19:05.306484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 480/803] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:05.310867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:05.311463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:05.317771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:05.318287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:05.318724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:05.319458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:05.319912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:05.320335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:05.381008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:05.383135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:05.389156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b41ca95-b91f-48d1-b665-e93b4d147fa7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081737 Sep 19 15:19:05.394590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 481/804] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:05 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:06.329492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:06.330097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:06.337447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:06.343523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:06.343523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:06.343523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:06.343523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:06.344018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:06.478450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:06.487754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-791abc7c-1e95-4c0b-970e-3f3495c83322 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.161570 Sep 19 15:19:06.488310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 482/805] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:06.492710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:06.493352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:06.498729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:06.499204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:06.499629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:06.500304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:06.500773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:06.501192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:06.564651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:06.572865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-841880d8-4dd2-47ed-a3fb-cca72f9e6c96 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083571 Sep 19 15:19:06.573416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 483/806] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:06 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:07.511254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:07.511909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:07.518670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:07.519155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:07.519593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:07.520287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:07.520772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:07.521200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:07.651121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:07.659578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c08be637-d240-47cb-b2a3-93999b56260a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151544 Sep 19 15:19:07.660341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 484/807] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:07.665121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:07.665736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:07.671811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:07.672299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:07.672767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:07.673473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:07.673934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:07.675002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:07.746810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:07.754731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8e5b8d94-954e-43ac-affd-2d9a314c2083 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.093378 Sep 19 15:19:07.755288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 485/808] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:07 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:08.687933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:08.688572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:08.702750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:08.703238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:08.703671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:08.705638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:08.705638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:08.705638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:08.849470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:08.857067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4cae9bf9-2e4f-4c03-86bc-b5076e1c315f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.173044 Sep 19 15:19:08.857620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 486/809] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:08.862945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:08.863539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:08.869085 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:08.869569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:08.870006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:08.870705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:08.871155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:08.871575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:08.932793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:08.941664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9e601ae2-417c-4940-8700-712ae14fc53c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083094 Sep 19 15:19:08.942228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 487/810] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:08 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:09.881505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:09.882119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:09.884441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:09.889107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:09.889591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:09.890028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:09.890724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:09.891181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:09.891606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.024069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:10.031875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aa4992d0-68e9-4e48-a6ed-e6541e786b1b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154680 Sep 19 15:19:10.032381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 488/811] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:10.037064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:10.037676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:10.043140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:10.043624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:10.044062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.044782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:10.045235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:10.045666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:10.108351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:10.117009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d73d723-61b9-4fe2-a4b7-4e08a365692f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083654 Sep 19 15:19:10.117566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 489/812] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:10 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:11.055427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:11.056108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:11.068337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:11.068879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:11.069323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:11.070029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:11.070537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:11.070957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:11.206521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:11.214528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c390b19-50e3-4a1c-8769-cc0c2211715c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.163061 Sep 19 15:19:11.215079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 490/813] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:11.219506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:11.220158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:11.225949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:11.226447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:11.226878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:11.227571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:11.228029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:11.228452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:11.289942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:11.297585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7dafa8e0-c3e1-4cab-8bd8-f46599638cc0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081564 Sep 19 15:19:11.298143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 491/814] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:11 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:12.238075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:12.242892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:12.244763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:12.245243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:12.245671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:12.246353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:12.246798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:12.247215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:12.382676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:12.390441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3e227318-f5b8-4aec-ade7-76e690db29f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156995 Sep 19 15:19:12.391052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 492/815] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:12.396309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:12.396935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:12.402513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:12.403007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:12.403428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:12.404113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:12.404592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:12.405017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:12.466181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:12.474937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2c7bbbb3-ac84-41df-a1fe-ca89ebb51e77 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082937 Sep 19 15:19:12.475507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 493/816] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:12 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:13.414583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:13.415269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:13.422000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.422488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.422926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.423634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.424098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.425182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.562861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:13.570603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c2f52eaf-cc2a-4b0b-ba9c-7358f38ecf39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.159972 Sep 19 15:19:13.571169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 494/817] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:13.575643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:13.576238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:13.581657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.582139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.582577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.583276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:13.583731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:13.584188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:13.649225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:13.657041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fcce82f6-3ce5-403a-84df-319cff51c2fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084932 Sep 19 15:19:13.657609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 495/818] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:13 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:14.593357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:14.593959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:14.601144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:14.601625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:14.602058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:14.602750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:14.603200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:14.603618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:14.734264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:14.742227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c7ea5dda-b05a-490c-8f7c-84a0063a45b3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152672 Sep 19 15:19:14.742731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 496/819] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:14.747053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:14.747636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:14.755958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:14.756711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:14.757149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:14.757850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:14.758324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:14.758723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:14.819122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:14.826684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-81ddca94-120a-4a96-8007-73b3b329b76a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083025 Sep 19 15:19:14.830214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 497/820] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:14 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:15.765589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:15.766247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:15.773017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:15.773501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:15.773939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:15.774636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:15.775093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:15.775519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:15.791092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:15.908399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:15.916691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c2c17cff-d80d-48d4-805a-c72644857651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154950 Sep 19 15:19:15.917254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 498/821] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:15.921604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:15.922212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:15.928363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:15.928882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:15.929324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:15.930021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:15.930472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:15.930892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:15.992114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:15.999848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2da05c01-9d28-48c8-8f0f-6c07acfa8f7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081648 Sep 19 15:19:16.000407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 499/822] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:15 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:16.940938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:16.941576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:16.947934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:16.948405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:16.948856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:16.949532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:16.949980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:16.950402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:17.079604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:17.087623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7de89d57-746e-40d1-8bc8-a6fe60a2ab7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151137 Sep 19 15:19:17.088184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 500/823] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:17.092499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:17.093111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:17.098994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:17.099482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:17.099922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:17.100682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:17.101140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:17.101573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:17.165021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:17.172801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ce49e846-3258-4231-8336-49b7137a7b8f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083609 Sep 19 15:19:17.173369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 501/824] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:17 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:18.111079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:18.112354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:18.118920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:18.119404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:18.119834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:18.120549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:18.121016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:18.121464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:18.255369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:18.263070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-367d9118-38ef-4ee0-8474-e4a9c88a7ffd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156123 Sep 19 15:19:18.263624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 502/825] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:18.268592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:18.269189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:18.274589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:18.275074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:18.275506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:18.276186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:18.276663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:18.277086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:18.339186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:18.347096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a9cb03ea-5d30-46cc-b08b-8fcb7ba87081 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082527 Sep 19 15:19:18.347665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 503/826] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:18 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:19.287299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:19.287970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:19.294328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:19.294811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:19.295250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:19.295942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:19.296395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:19.296845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:19.430405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:19.438109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2383bf43-5a2f-483e-a94b-b192f9383144 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155361 Sep 19 15:19:19.438670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 504/827] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:19.443494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:19.444099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:19.449547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:19.450028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:19.450464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:19.451152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:19.451608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:19.452030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:19.511675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:19.520088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-46523b39-8680-403e-9b03-610b98afbc97 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080469 Sep 19 15:19:19.520680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 505/828] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:19 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:20.462170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:20.462840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:20.469232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:20.469703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:20.470125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:20.470805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:20.471771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:20.472389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:20.603839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:20.611754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-76167c18-736d-4b34-af0e-033fa8e9b1e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153458 Sep 19 15:19:20.612310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 506/829] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:20.616637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:20.617268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:20.622628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:20.623099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:20.623528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:20.624202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:20.624683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:20.625101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:20.688899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:20.696650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-abdc8fe5-f608-48df-8dd3-0b95202cafcc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083351 Sep 19 15:19:20.697212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 507/830] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:20 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:21.634955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:21.635650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:21.642058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:21.642539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:21.643478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:21.644169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:21.644647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:21.645070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:21.776538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:21.784417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3623317a-0d9a-4484-9fd5-36694691634e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153335 Sep 19 15:19:21.785175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 508/831] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:21.789554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:21.790193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:21.795678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:21.796160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:21.796628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:21.797322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:21.797780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:21.798202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:21.858299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:21.866593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-40753033-9d60-4d7b-b3f3-9398a754731e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080471 Sep 19 15:19:21.867157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 509/832] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:21 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:22.807237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:22.807775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:22.814360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:22.815045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:22.815731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:22.816426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:22.816903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:22.817328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:22.949318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:22.957630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8dc52a5c-8e32-4c27-a985-ba7bcd90fcad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154358 Sep 19 15:19:22.958185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 510/833] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:22.962754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:22.963357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:22.968736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:22.969217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:22.969650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:22.970333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:22.970784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:22.971798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:23.035413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:23.043189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b9c9b23-44ca-4cce-9306-d5fe0ef71b6b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084059 Sep 19 15:19:23.043751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 511/834] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:22 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:23.980643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:23.981255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:23.988939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:23.989419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:23.989859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:23.990546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:23.990999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:23.991419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.140133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:24.148094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4c3bd2f0-ea4e-4306-ac25-77c2f99cec7e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.171349 Sep 19 15:19:24.148673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 512/835] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:24.152993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:24.153583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:24.159499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.159967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.160397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.161098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:24.161542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:24.161954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:24.228388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:24.237254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4a76fad0-f565-4272-90d0-ea006d740aeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086942 Sep 19 15:19:24.237818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 513/836] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:24 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:25.172107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:25.172785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:25.179267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:25.179750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:25.180186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:25.180905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:25.181361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:25.181785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:25.313258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:25.321775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-64f25125-0090-4ca2-b72e-c85031dfd88a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153453 Sep 19 15:19:25.322340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 514/837] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:25.326717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:25.327323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:25.333599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:25.334080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:25.334514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:25.335203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:25.335658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:25.336083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:25.339949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:25.396893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:25.404420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0f3ecb6a-3a24-4af7-bc5d-cdc37f12a786 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081137 Sep 19 15:19:25.405007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 515/838] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:25 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:26.345793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:26.346611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:26.353046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.353520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.353954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.354629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.355071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.355485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.489205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:26.496827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2dbff115-859f-4dd2-a77f-34377cb2cf3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154961 Sep 19 15:19:26.497375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 516/839] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:26.501780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:26.503007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:26.508470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.509057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.509487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.510162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:26.510604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:26.511015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:26.573088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:26.581161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4d8008c5-d725-46ff-b8dd-4961028d2005 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082661 Sep 19 15:19:26.581723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 517/840] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:26 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:27.524418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:27.525173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:27.531532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:27.532012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:27.532450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:27.533169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:27.534240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:27.534670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:27.666127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:27.673805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-24cc13ea-4e22-442e-a9e0-ab4d19bd3801 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153243 Sep 19 15:19:27.674525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 518/841] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:27.678868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:27.679469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:27.684951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:27.685431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:27.685866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:27.686563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:27.687019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:27.687444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:27.751309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:27.759884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bdaf25b8-cfb6-4ae6-a0be-5449adb0d709 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084416 Sep 19 15:19:27.760439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 519/842] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:27 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:28.697030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:28.697688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:28.703946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:28.704414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:28.704869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:28.705682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:28.706516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:28.706931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:28.846984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:28.854631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c05c2ca9-2948-43d2-9483-170d3b9482a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.161518 Sep 19 15:19:28.855177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 520/843] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:28.859499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:28.860095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:28.866405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:28.866884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:28.867315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:28.867999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:28.868452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:28.868897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:28.928969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:28.936674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c5a61d48-a12f-4b65-833f-5921b47b00ee tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080521 Sep 19 15:19:28.937230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 521/844] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:28 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:29.878962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:29.879578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:29.885986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:29.886472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:29.886909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:29.887594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:29.888049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:29.888500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:30.023422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:30.031169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ecd37878-17fa-469a-afd5-3d770d774433 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156144 Sep 19 15:19:30.031663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 522/845] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:30.036031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:30.036654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:30.042049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:30.042520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:30.042949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:30.043625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:30.044067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:30.044509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:30.105709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:30.113787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1cdd7dca-68e4-4c16-821a-096b55ce1779 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081197 Sep 19 15:19:30.114338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 523/846] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:30 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:31.055125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:31.055806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:31.062213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:31.062692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:31.063137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:31.063820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:31.064272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:31.064797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:31.196142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:31.203797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fdc9a0d3-c3c0-4747-a4bd-79d055006b4d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152682 Sep 19 15:19:31.204358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 524/847] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:31.209235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:31.209834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:31.215211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:31.215687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:31.216122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:31.216832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:31.217289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:31.217710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:31.282305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:31.290172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e1f5d286-d654-4556-8470-83c3e284ae2b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084824 Sep 19 15:19:31.290736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 525/848] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:31 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:32.227554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:32.228223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:32.234780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:32.235258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:32.235949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:32.236805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:32.237254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:32.237671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:32.445225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:32.452881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-98530241-203e-42a1-8306-550943384b7b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.229154 Sep 19 15:19:32.453434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 526/849] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:32.458366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:32.458962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:32.464286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:32.464789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:32.465217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:32.465898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:32.466344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:32.466757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:32.526999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:32.534673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-69da7be1-498f-4375-9741-f6c462222240 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080299 Sep 19 15:19:32.535540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 527/850] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:32 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:33.477313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:33.478001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:33.484316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:33.484829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:33.485267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:33.486219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:33.486698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:33.487120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:33.619961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:33.627798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-84b0a600-3dad-4a63-8b46-ac1ddd4d5b0c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154298 Sep 19 15:19:33.628357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 528/851] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:33.632753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:33.633356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:33.638803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:33.639278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:33.639716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:33.640403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:33.640898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:33.641321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:33.702019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:33.710650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e201548f-83ac-4bd0-9222-7328688eb85b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081300 Sep 19 15:19:33.711214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 529/852] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:33 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:34.651625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:34.652301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:34.658857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:34.659336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:34.659773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:34.660462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:34.660939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:34.661362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:34.800371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:34.808158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-42a5aadb-88ac-4eca-ada9-729b89df6282 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160410 Sep 19 15:19:34.808751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 530/853] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:34.813379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:34.814024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:34.820116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:34.820631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:34.821065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:34.821753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:34.822207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:34.822628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:34.886221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:34.888409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:34.894485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dc7b2e6c-2f67-4475-aceb-4b2590bcdc2c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084779 Sep 19 15:19:34.895046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 531/854] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:34 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:35.831957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:35.832579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:35.839272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.839748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.840177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.840883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.841326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.841745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.971270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:35.979215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d1b8bfc-b995-4317-bfbb-9e4add9664d5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151160 Sep 19 15:19:35.979762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 532/855] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:35.984090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:35.984718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:35.991237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.991721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.992154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:35.992875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:35.993328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:35.993750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:36.053762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:36.061455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cdd35bc7-6477-46a0-b3e0-02c7ac5b4383 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080760 Sep 19 15:19:36.062019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 533/856] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:35 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:37.003871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:37.004519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:37.010563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.011043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.011476 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.012164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.012646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.013075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.150632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:37.158998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-000238c7-9dde-4140-aa5d-9beb1f84de79 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158592 Sep 19 15:19:37.159562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 534/857] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:37.164013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:37.164652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:37.170124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.170607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.171039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.171735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:37.172191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:37.172712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:37.236003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:37.241770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a43c8829-a9cb-448d-aa21-0682cfc39b43 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081252 Sep 19 15:19:37.242342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 535/858] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:37 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:38.182095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:38.182746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:38.189260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:38.190373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:38.190889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:38.191577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:38.192032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:38.192449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:38.326995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:38.335408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e99dfb23-ca2e-4dab-805f-8fc15da9fe82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157150 Sep 19 15:19:38.335975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 536/859] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:38.340345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:38.340967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:38.347264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:38.347735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:38.348162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:38.348881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:38.349327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:38.349744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:38.413943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:38.421612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-280f4096-a5f7-455c-8abf-791261ec55e7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084694 Sep 19 15:19:38.422197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 537/860] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:38 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:39.359275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:39.359887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:39.362771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:39.368010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:39.368520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:39.368967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:39.369714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:39.370172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:39.370598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:39.459153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: volume f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 is already attached to instances: 2751262b-7323-4c6a-b3f1-830fb2448558 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: POST /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/os-volume_attachments HTTP/1.1 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 74 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:19:39.460954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {"volumeAttachment": {"volumeId": "f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4"}} Sep 19 15:19:39.462354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: volume f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 is already attached to instances: 2751262b-7323-4c6a-b3f1-830fb2448558 Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '472c71ee-5670-4562-bfac-24f97b292419', 'body': {'volumeAttachment': {'volumeId': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'}}} Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 is already attached to instances: 2751262b-7323-4c6a-b3f1-830fb2448558 Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:19:39.463504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 is already attached to instances: 2751262b-7323-4c6a-b3f1-830fb2448558 Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:19:39.469743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 is already attached to instances: 2751262b-7323-4c6a-b3f1-830fb2448558 Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: volume f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 is already attached to instances: 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2f8e734-8957-4f74-aa57-ccadb6af507d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 113.853986 Sep 19 15:19:39.472613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 324/861] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:17:45 2022] POST /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419/os-volume_attachments => generated 174 bytes in 113855 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:19:39.473282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:39.473282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:39.477038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:39.477535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:39.478187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:39.478938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:39.479440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:39.480275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:39.539284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:39.547209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a7c87142-5fc6-4c13-b48a-aaac4f68df89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.191772 Sep 19 15:19:39.547773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 538/862] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:39.567462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:39.575470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-16e49a35-6448-481e-b525-73f649e078cb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.111274 Sep 19 15:19:39.576186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 325/863] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:39 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:39.706760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:39.712769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:39.713568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:39.714052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:39.714530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:39.715163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:39.715614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:39.716037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:40.569915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:40.570529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:40.577059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:40.577543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:40.577982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:40.578680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:40.579138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:40.579581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:40.715969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:40.724245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-58ceda65-bbb1-4f08-a743-d26a2e83b880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158249 Sep 19 15:19:40.724846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 326/864] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:40.729380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:40.729994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:40.735630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:40.736451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:40.736923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:40.737623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:40.738088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:40.738516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:40.800434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:40.808174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-56eed4e1-07ea-433c-a93c-3b30c5d1fd49 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082378 Sep 19 15:19:40.808778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 327/865] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:40 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:41.747854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:41.748564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:41.755747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:41.756232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:41.756696 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:41.757398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:41.757851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:41.758272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:41.888412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:41.896331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-aebd46ae-bcf1-4888-aee4-51fa03cc7180 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152450 Sep 19 15:19:41.896952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 328/866] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:41.901314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:41.901911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:41.907337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:41.907817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:41.908706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:41.909428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:41.909885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:41.910312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:41.973594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:41.981248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f7206b21-2bc7-4e08-b702-e18bfd3e44dc tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083351 Sep 19 15:19:41.981810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 329/867] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:41 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:42.919749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:42.920396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:42.927018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:42.927502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:42.927945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:42.928674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:42.929162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:42.929591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:43.062393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:43.070763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bc74ad37-9b8b-4154-aa4c-f1571b777aa4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154872 Sep 19 15:19:43.071339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 330/868] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:43.075685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:43.076313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:43.081938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:43.082415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:43.082851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:43.083541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:43.083994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:43.084415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:43.144903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:43.153029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cdc00a6a-b146-4c67-9a3a-7730c214aaeb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080741 Sep 19 15:19:43.153591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 331/869] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:43 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:44.094060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:44.094704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:44.102073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:44.102553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:44.102984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:44.103676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:44.104124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:44.104578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:44.238392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:44.246087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-adb24c52-4994-41ea-a033-43f15c72006d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155941 Sep 19 15:19:44.246643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 332/870] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:44.250961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:44.251607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:44.257457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:44.257931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:44.258365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:44.259043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:44.259500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:44.259919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:44.320061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:44.327769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fd6d5f95-cb8c-4403-b6f0-51245df3ba47 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080194 Sep 19 15:19:44.328329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 333/871] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:44 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:45.268852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:45.269524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:45.275895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:45.276380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:45.276853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:45.277547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:45.278004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:45.278431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:45.408848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:45.416628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c2eaa486-6863-4f47-b599-330a51ac5cfc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151801 Sep 19 15:19:45.417198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 334/872] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:45.421629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:45.422234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:45.428641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:45.429127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:45.429564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:45.430253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:45.430704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:45.431131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:45.494882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:45.502718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-933617bf-7457-498f-9212-0a31e91017a5 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084512 Sep 19 15:19:45.503275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 335/873] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:45 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:46.439097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:46.440396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:46.446845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:46.452597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:46.452597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:46.452597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:46.452597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:46.452984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:46.579327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:46.587816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d6ed47ec-beba-431e-87c8-b6de69ff5a94 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152563 Sep 19 15:19:46.588385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 336/874] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:46.592923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:46.593527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:46.599122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:46.599606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:46.600048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:46.600769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:46.601230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:46.601663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:46.663419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:46.671019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0dff8489-b7bb-4496-bccf-140afc8b8eb6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081641 Sep 19 15:19:46.671566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 337/875] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:46 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:47.610665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:47.611702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:47.618112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:47.618597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:47.619038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:47.619739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:47.620194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:47.620665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:47.754498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:47.762283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9e63d07b-470a-4452-a165-dd989def08df tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.155598 Sep 19 15:19:47.762844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 338/876] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:47.767200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:47.768362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:47.773896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:47.774382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:47.774822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:47.775516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:47.775973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:47.776396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:47.837388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:47.845052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a04958ba-8a07-47d9-af7e-ebd7f9820df0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081264 Sep 19 15:19:47.846243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 339/877] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:47 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:48.787232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:48.787914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:48.795608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:48.799484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:48.799484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:48.799484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:48.799484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:48.799858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:49.244138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:49.251936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2f702274-4669-490f-9ee0-ac7cbf720910 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.469013 Sep 19 15:19:49.261867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 340/878] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:49.261867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:49.261867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:49.263271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:49.263762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:49.264203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:49.264965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:49.265420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:49.265841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:49.270588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:49.332606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:49.340735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3da44cf7-9e80-4ee9-ae8d-7c373e013c8d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086915 Sep 19 15:19:49.342243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 341/879] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:49 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:49.711201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:49.778644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=47 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:50.275895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:50.276558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:50.283636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:50.284121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:50.284657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:50.285375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:50.287044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:50.287478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:50.424961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:50.433009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5c211fe0-c202-46ee-b3e9-20a7704742c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160767 Sep 19 15:19:50.433588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 342/880] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:50.438584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:50.439901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:50.445830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:50.446318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:50.446752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:50.447449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:50.447959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:50.448366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:50.513170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:50.521635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-577e0b55-d882-4e99-b5ce-fb44c06444bf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.087080 Sep 19 15:19:50.522206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 343/881] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:50 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:51.456983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:51.457648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:51.463954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.464430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.464900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.465583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.466032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.466453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.598235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:51.605994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8492c244-d844-4555-862c-84ba7b4c1a62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153394 Sep 19 15:19:51.606559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 344/882] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:51.610868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:51.611756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:51.617239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.617715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.618143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.618832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:51.619284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:51.619708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:51.682294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:51.695753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-61c3cf1a-cee3-46a9-b2bc-cdd2b4864c18 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.088163 Sep 19 15:19:51.696319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 345/883] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:51 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:52.628683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:52.629271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:52.635583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:52.636095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:52.636551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:52.637232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:52.637679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:52.638091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:52.768663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:52.776689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-73b2eea5-5ab2-4b39-9ffb-2444c328d10b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152030 Sep 19 15:19:52.777253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 346/884] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:52.781678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:52.782288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:52.788960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:52.789441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:52.789880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:52.790570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:52.791025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:52.791449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:52.856418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:52.864829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-55f140c5-0aa5-4f62-b412-8540c10e0f3b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086598 Sep 19 15:19:52.865395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 347/885] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:52 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:53.800936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:53.801544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:53.807962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:53.808436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:53.808907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:53.809589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:53.810040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:53.810456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:53.938938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:53.947284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c1daaff2-0d6d-4f85-9362-7cc0fa43deba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150936 Sep 19 15:19:53.947849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 348/886] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:53.952206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:53.952830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:53.958596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:53.959076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:53.959515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:53.960214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:53.960704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:53.961130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:54.030669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:54.039049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9cdf0858-b493-4b76-8b00-aa991f68051c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.090261 Sep 19 15:19:54.039609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 349/887] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:53 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:54.972659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:54.973893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:54.980710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:54.983187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:54.984739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:54.985490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:54.985962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:54.986816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:55.146081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:55.155552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-82d6540f-1edb-4c95-aa3c-e52700cf12c0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.188392 Sep 19 15:19:55.156257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 350/888] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:55.163587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:55.164807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:55.173701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:55.174599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:55.175377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:55.176600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:55.177417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:55.178182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:55.254214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:55.262485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-19c1dfa2-f044-4d93-b708-1875478dcc6d tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.104785 Sep 19 15:19:55.263058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 351/889] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:55 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:56.178450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:56.179059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:56.185568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:56.186045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:56.186477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:56.187156 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:56.187603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:56.188020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:56.322081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:56.327486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-18519a58-1706-4278-bcf4-5370291710bd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152968 Sep 19 15:19:56.328051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 352/890] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:56.332794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:56.333492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:56.339466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:56.339956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:56.340381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:56.341106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:56.341555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:56.341975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:56.406415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:56.414346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4cf7f688-33f4-406d-b05f-83cd39f7df61 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085330 Sep 19 15:19:56.414920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 353/891] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:56 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:57.355086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:57.355757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:57.362940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:57.363412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:57.363842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:57.364553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:57.365004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:57.365423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:57.497330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:57.504910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4ebd1a95-adc0-44bd-a060-89c60817f96e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153672 Sep 19 15:19:57.505588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 354/892] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:57.509953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:57.510543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:57.516154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:57.516672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:57.517302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:57.518162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:57.518652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:57.519076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:57.580868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:57.588607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-85e8d317-f672-4779-b8b5-03f167f9459e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082043 Sep 19 15:19:57.589176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 355/893] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:57 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:58.528588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:58.529307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:58.535942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:58.536422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:58.536881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:58.537605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:58.538059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:58.538516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:58.677336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:58.685135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-30ab311b-2629-46f9-87b8-4d2395f318d8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160500 Sep 19 15:19:58.685701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 356/894] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:58.690167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:58.690772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:58.696948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:58.697436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:58.697874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:58.698569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:58.699028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:58.699460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:58.759619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:58.763084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:19:58.768431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ba1b952d-308b-4d97-ac17-76489b8b5e65 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081625 Sep 19 15:19:58.769018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 357/895] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:58 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:19:59.710197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:59.710875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:59.717579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:59.718054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:59.718517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:59.719202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:59.719647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:59.720063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:59.850627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:59.858483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6a201a48-d5a8-4dc2-91da-952d2b0c48d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152729 Sep 19 15:19:59.859048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 358/896] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:19:59.864354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:19:59.864982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:19:59.870449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:59.870920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:59.871352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:59.872063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:19:59.872531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:19:59.872950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:19:59.936203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:19:59.949781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-86b55cc5-d916-4ee8-b90c-840fec5fea1c tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.089468 Sep 19 15:19:59.950132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 359/897] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:19:59 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:00.881860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:00.882488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:00.888953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:00.889436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:00.889874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:00.890567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:00.891023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:00.891449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:01.033602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:01.041580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d8eb79dc-d7b7-4908-81e9-6710e07b1c23 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.163601 Sep 19 15:20:01.042152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 360/898] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:01.046519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:01.047146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:01.052964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:01.053451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:01.053884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:01.054573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:01.055027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:01.055452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:01.124870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:01.133272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a1ec04f5-ce95-4094-b685-e21ad6fc4e19 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.090104 Sep 19 15:20:01.133777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 361/899] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:01 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:02.064997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:02.065633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:02.072079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:02.072592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:02.073033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:02.073770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:02.074257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:02.074688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:02.207954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:02.215570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d615fe61-6902-414d-a787-9ebd295287a1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154526 Sep 19 15:20:02.216133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 362/900] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:02.221240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:02.221952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:02.227578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:02.228067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:02.228518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:02.229323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:02.229776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:02.230197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:02.293205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:02.301398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-53e0de8b-4393-4f24-ba43-873d3e9e892f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084293 Sep 19 15:20:02.301959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 363/901] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:02 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:03.239883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:03.240591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:03.247260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:03.247745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:03.248184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:03.249230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:03.249706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:03.250132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:03.380702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:03.388295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5cebcba9-f13e-46ac-b9bd-4b09c3e0fc49 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153085 Sep 19 15:20:03.388885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 364/902] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:03.393298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:03.393893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:03.399330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:03.399804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:03.400234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:03.400944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:03.401393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:03.401811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:03.465953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:03.474275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-285da187-8625-4dce-9c5a-241f9dbbe07b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084442 Sep 19 15:20:03.474841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 365/903] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:03 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:04.411648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:04.412302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:04.418769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:04.419253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:04.419689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:04.420386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:04.420868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:04.421295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:04.552319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:04.560527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f8544ea2-f3a2-456b-9a4a-9fd115e562a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152769 Sep 19 15:20:04.561094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 366/904] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:04.566701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:04.567302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:04.572986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:04.573472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:04.573909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:04.574619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:04.575055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:04.575475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:04.635891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:04.643876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-748b976a-b4db-4449-90db-ace23983cbfb tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081845 Sep 19 15:20:04.644446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 367/905] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:04 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:05.584972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:05.585607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:05.591973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:05.592449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:05.592914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:05.593597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:05.594045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:05.594460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:05.727691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:05.735332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-14064911-abf2-4e33-b34c-82e5645d7f83 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154261 Sep 19 15:20:05.735892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 368/906] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:05.740694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:05.741293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:05.742894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=89 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:05.747295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:05.747770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:05.752765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:05.752765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:05.752765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:05.752765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:05.810645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:05.818945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2794482f-8b3c-4858-86f6-8f9b0848baa4 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081728 Sep 19 15:20:05.819498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 369/907] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:05 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:06.758853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:06.759500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:06.765626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:06.766111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:06.766546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:06.767264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:06.767817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:06.768253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:06.899567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:06.907225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f95ada8e-d2ef-4b3b-960c-70d192768fa0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152252 Sep 19 15:20:06.908472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 370/908] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:06.912889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:06.913493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:06.918951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:06.919467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:06.919906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:06.920796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:06.921256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:06.921684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:06.987918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:06.995618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bfb56ec7-8117-45e1-9b2f-e4dca24bb7dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086178 Sep 19 15:20:06.996179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 371/909] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:06 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:07.931400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:07.932023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:07.938430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:07.939435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:07.939875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:07.940595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:07.941056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:07.941481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:08.076472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:08.084451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe1d54c3-3d4c-48f0-a786-2a9513e273eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156959 Sep 19 15:20:08.085165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 372/910] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:08.089588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:08.090190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:08.096746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:08.097235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:08.097675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:08.098370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:08.098828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:08.099284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:08.160273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:08.167807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a99b32be-b032-4c0e-bb26-8fa281adca95 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081701 Sep 19 15:20:08.168364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 373/911] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:08 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:09.107869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:09.108537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:09.115690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:09.116164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:09.116622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:09.117307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:09.117754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:09.118176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:09.136057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:09.252396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:09.260155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c82fe47d-4336-4b6f-825d-de5a1b99db6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.156180 Sep 19 15:20:09.260770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 374/912] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:09.265113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:09.265711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:09.271559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:09.272040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:09.272495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:09.273181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:09.273636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:09.274057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:09.334364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:09.341871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-49cebc1a-0c60-4de7-96dc-0affdeae1d59 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080159 Sep 19 15:20:09.342434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 375/913] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:09 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:10.283423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:10.284121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:10.290578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:10.291060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:10.291492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:10.292181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:10.292675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:10.293246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:10.430414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:10.438239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-34346162-88e7-43df-a6ba-8ae0b0c4c6b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158915 Sep 19 15:20:10.439453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 376/914] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:10.443718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:10.444321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:10.449790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:10.450270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:10.450706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:10.451394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:10.451855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:10.452282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:10.516635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:10.524316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2a32279f-3623-41c9-80d7-3aebed7ba2bd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084060 Sep 19 15:20:10.524913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 377/915] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:10 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:11.462235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:11.462852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:11.469215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:11.469697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:11.470131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:11.471662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:11.472152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:11.472610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:11.603314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:11.610962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-de997f97-68ad-41da-8af0-4ab2ad41b8de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152700 Sep 19 15:20:11.611864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 378/916] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:11.616507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:11.617121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:11.622563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:11.623041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:11.623476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:11.624161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:11.624646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:11.625075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:11.685859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:11.694178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c8db78ad-1035-4b21-bd67-d6f95fc0c884 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081069 Sep 19 15:20:11.694742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 379/917] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:11 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:12.634097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:12.634710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:12.641269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:12.641753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:12.642188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:12.643393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:12.643838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:12.644265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:12.778830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:12.787416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4025a8f5-fbf7-4238-9e2f-2f2ba23cf01e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157275 Sep 19 15:20:12.787981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 380/918] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:12.792312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:12.792938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:12.798360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:12.798878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:12.799306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:12.799995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:12.800449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:12.800897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:12.860187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:12.868020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9b068f4c-77f6-4d2d-9cde-43f023e8de1b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.079106 Sep 19 15:20:12.868600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 381/919] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:12 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:13.810341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:13.810969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:13.818079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:13.818563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:13.819013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:13.819705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:13.820162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:13.820627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:13.949229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:13.956986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-558e24b9-f166-409a-9eef-e2f79039c07f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.150504 Sep 19 15:20:13.957562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 382/920] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:13.961916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:13.962519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:13.967927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:13.968408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:13.968895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:13.969587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:13.970044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:13.970473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:14.034405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:14.042092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6d94dc4d-5d05-4ca0-9e12-58e720255318 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.083586 Sep 19 15:20:14.042659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 383/921] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:13 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:14.980876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:14.981529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:14.988818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:14.989460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:14.989806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:14.990511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:14.990969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:14.991397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:15.122460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:15.130855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e329d44-8d5f-4e13-aa11-dfb9fe2b65c9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154088 Sep 19 15:20:15.131415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 384/922] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:15.135726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:15.136325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:15.141735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:15.142213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:15.143320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:15.144000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:15.144458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:15.144904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:15.205833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:15.213864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-376763f4-a4d9-4e67-839e-dafcca618e98 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081508 Sep 19 15:20:15.214429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 385/923] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:15 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:16.154637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:16.155326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:16.162566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:16.163053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:16.163493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:16.164191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:16.164682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:16.165113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:16.296848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:16.305198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ed437364-e546-4636-b103-1d28c8c50651 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154445 Sep 19 15:20:16.305765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 386/924] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:16.310279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:16.310889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:16.316736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:16.317218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:16.317649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:16.318346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:16.318829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:16.319253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:16.383073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:16.391096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-866b2953-1c52-4518-bdc4-d437d7549b7f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084344 Sep 19 15:20:16.392763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 387/925] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:16 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:17.329765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:17.330687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:17.337153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:17.337635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:17.338074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:17.338769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:17.339222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:17.339685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:17.470729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:17.478502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea09c620-0600-4910-a99c-12c441259e32 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153334 Sep 19 15:20:17.479070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 388/926] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:17.483438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:17.484042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:17.490425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:17.490950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:17.491393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:17.492099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:17.492671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:17.493149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:17.556453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:17.564118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d00e3e89-c500-431d-b0c4-5ab2653b10a0 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084094 Sep 19 15:20:17.565405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 389/927] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:17 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:18.502902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:18.503583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:18.509798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:18.510273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:18.510703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:18.511386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:18.511835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:18.512253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:18.643796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:18.651523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2b29f073-a794-439e-88f0-e411b0c72c3c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152978 Sep 19 15:20:18.652090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 390/928] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:18.656633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:18.657244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:18.663089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:18.663574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:18.664013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:18.664745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:18.665201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:18.665632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:18.669554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:18.726413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:18.734031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-01af04f9-ccc2-4483-ae4f-37be8243ca07 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080974 Sep 19 15:20:18.734591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 391/929] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:18 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:19.674469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:19.675343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:19.681986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:19.682461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:19.682894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:19.683590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:19.684039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:19.684457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:19.816872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:19.824448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5c320256-8d9f-41fb-94fb-0a48c770475d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.153842 Sep 19 15:20:19.825098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 392/930] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:19.829397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:19.830587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:19.835928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:19.836397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:19.836860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:19.837545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:19.837995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:19.838409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:19.900051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:19.907524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-83573455-c71a-477f-8a5d-cf5441f13066 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081507 Sep 19 15:20:19.908599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 393/931] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:19 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:20.848420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:20.849063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:20.855310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:20.855782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:20.856209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:20.856927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:20.857376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:20.857791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:20.987626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:20.995668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cbef3afe-1d35-4bb1-b331-649a358e31ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151877 Sep 19 15:20:20.996252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 394/932] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:21.000604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:21.001202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:21.006712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:21.007187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:21.007617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:21.008300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:21.008818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:21.009244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:21.075665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:21.084285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d1f932f9-e565-4e93-ab42-272d03919337 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.087042 Sep 19 15:20:21.086209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 395/933] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:20 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:22.019179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:22.019837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:22.026366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:22.026847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:22.027281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:22.028021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:22.028425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:22.028888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:22.160013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:22.167729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ecbf1ba1-e05c-4ddd-b507-93e486ddd89b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152712 Sep 19 15:20:22.168298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 396/934] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:22.172815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:22.173421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:22.179655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:22.180134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:22.180591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:22.181293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:22.181746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:22.182172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:22.243761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:22.251502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6546d7b2-ef83-43f0-b51a-1fb805ff2f1f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082230 Sep 19 15:20:22.252248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 397/935] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:22 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:23.192441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:23.193097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:23.199489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:23.199973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:23.200405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:23.201124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:23.201576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:23.202002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:23.334603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:23.342357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8f9f0035-d9c7-42e6-abcc-e6358e3ec992 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154468 Sep 19 15:20:23.342917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 398/936] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:23.347442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:23.348043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:23.353555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:23.354044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:23.354482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:23.355182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:23.355641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:23.356068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:23.416282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:23.424464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dc212389-a191-4a1d-b5b0-38fb34cba06e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.079971 Sep 19 15:20:23.425267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 399/937] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:23 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:24.367167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:24.369478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:24.376395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:24.376395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:24.376395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:24.376395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:24.377754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:24.377754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:24.511441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:24.519749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2d72dc3e-b18b-4855-80bb-2af524e50a0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.157185 Sep 19 15:20:24.520295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 400/938] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:24.524918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:24.525537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:24.531119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:24.531605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:24.532046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:24.532923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:24.534126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:24.534126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:24.598158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:24.605951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0febed56-adf6-4e94-aeb3-13507dbd00a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084674 Sep 19 15:20:24.606513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 401/939] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:24 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:25.543357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:25.544035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:25.550559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:25.551043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:25.551483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:25.552181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:25.552667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:25.553097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:25.689953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:25.697723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3ca6bb38-b54d-4c1f-85c1-6e3d60533042 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158256 Sep 19 15:20:25.698289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 402/940] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:25.702758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:25.703355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:25.709479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:25.709961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:25.710398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:25.711087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:25.711543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:25.711976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:25.772784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:25.780593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cc8b47e0-61b4-4270-a879-935567ef74dd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081313 Sep 19 15:20:25.781166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 403/941] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:25 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:26.722182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:26.722808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:26.729326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:26.729814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:26.730255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:26.730946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:26.731405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:26.731830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:26.873154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:26.880916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-699eae12-520c-4324-922c-35f24dd68578 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.163121 Sep 19 15:20:26.881479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 404/942] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:26.885829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:26.886430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:26.892003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:26.892502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:26.892972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:26.893717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:26.894172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:26.894595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:26.954451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:26.962566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-35ad31e9-7807-4fee-88bb-807b8726b6ce tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080140 Sep 19 15:20:26.963135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 405/943] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:26 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:27.904006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:27.904741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:27.911253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:27.911736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:27.912171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:27.912897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:27.913361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:27.913787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:28.043340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:28.051789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e34fa1ad-f0fd-450a-b992-c618f6215033 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151663 Sep 19 15:20:28.052354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 406/944] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:28.056705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:28.057323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:28.062794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:28.063280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:28.063723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:28.065060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:28.065521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:28.065947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:28.129987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:28.133395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:28.137910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-16d200c4-6a88-4418-8a57-fae7839284fe tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084600 Sep 19 15:20:28.138477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 407/945] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:28 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:29.076020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:29.076692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:29.083270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:29.083747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:29.084182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:29.084893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:29.085344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:29.085765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:29.214858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:29.223302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e349a37b-61d7-44b0-8aa4-d0553730e52d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151512 Sep 19 15:20:29.223909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 408/946] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:29.228311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:29.228941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:29.234411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:29.234894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:29.235330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:29.236081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:29.236817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:29.237336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:29.297560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:29.305184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-17ae41d7-7df2-45c9-8bf4-09a44950c10b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080328 Sep 19 15:20:29.305751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 409/947] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:29 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:30.247113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:30.247770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:30.255042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:30.255520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:30.255965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:30.256677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:30.257134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:30.257558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:30.394355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:30.402175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3f1cca40-bf52-487d-98a3-72724d5dfce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158935 Sep 19 15:20:30.402744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 410/948] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:30.407063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:30.407701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:30.415812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:30.416294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:30.416758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:30.417452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:30.417908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:30.418333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:30.480664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:30.489392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-80a368c5-6dc7-41e3-b60b-e245bde0fe58 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.085706 Sep 19 15:20:30.489949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 411/949] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:30 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:31.426523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:31.427196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:31.433667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:31.434148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:31.434576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:31.435262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:31.435710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:31.436127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:31.567166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:31.574795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-87efd5ab-3d4a-44be-b980-f4dd08ccd969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152694 Sep 19 15:20:31.575350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 412/950] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:31.579938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:31.580565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:31.586244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:31.586851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:31.587301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:31.588033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:31.588509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:31.588943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:31.652881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:31.664298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-42458694-45f0-4b68-b64a-5dedd581869a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.087982 Sep 19 15:20:31.664896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 413/951] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:31 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:32.598251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:32.599066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:32.605590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:32.606073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:32.606505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:32.607194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:32.607644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:32.608064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:32.738547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:32.746155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-37fb2a80-9d23-4a38-b39e-3717085504b2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.151772 Sep 19 15:20:32.746714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 414/952] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:32.751256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:32.752391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:32.758264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:32.758747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:32.759181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:32.759874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:32.760326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:32.760772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:32.821555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:32.829129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d44b9551-f04f-42e5-b597-27a43d7ae67b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081401 Sep 19 15:20:32.829664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 415/953] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:32 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:33.769848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:33.770485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:33.776958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:33.777440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:33.777873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:33.778569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:33.779026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:33.779449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:33.912547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:33.920211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2c5d307c-2b98-4843-bdae-b861e160d6d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154496 Sep 19 15:20:33.920807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 416/954] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:33.925846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:33.926442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:33.931891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:33.932371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:33.932840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:33.933526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:33.933979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:33.934400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:33.994672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:34.002933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8617fe3c-8634-4a79-ae72-d87b523a0c4e tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081157 Sep 19 15:20:34.003496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 417/955] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:33 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:34.943866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:34.944517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:34.950820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:34.951303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:34.951827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:34.952548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:34.953012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:34.953438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:35.086195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:35.093905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-16d86071-7127-43e2-bf0f-e569a072b497 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.154605 Sep 19 15:20:35.094470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 418/956] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:35.098908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:35.099512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:35.101171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:35.105670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:35.106146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:35.106585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:35.107343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:35.107804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:35.108234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:35.173887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:35.181667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-af60375c-3d0c-4654-82b9-603b9a98b376 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.086247 Sep 19 15:20:35.182229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 419/957] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:35 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:36.118575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:36.119198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:36.125456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.125950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.126394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.127248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.127711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.128140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.404283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:36.412590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f231d266-64ff-4a1e-b080-7ff727c007a2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.298019 Sep 19 15:20:36.413182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 420/958] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:36.417610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:36.418282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:36.424574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.425139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.425581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.426279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:36.426736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:36.427163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:36.488255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:36.495927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-10c0811d-4933-4ff6-900a-1991a863b592 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081800 Sep 19 15:20:36.496509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 421/959] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:36 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:37.437014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:37.437697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:37.444117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.444627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.445062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.445750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.446202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.446624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.582688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:37.591964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8e2cdf34-560f-4f24-b92c-80c70d36ce89 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.158854 Sep 19 15:20:37.592546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 422/960] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:37.598130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:37.598732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:37.604525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.605011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.605442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.606129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:37.606577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:37.607000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:37.668130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:37.675908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5cd0cbc9-20cb-4ee3-b348-2155a0cefff6 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.082415 Sep 19 15:20:37.676467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 423/961] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:37 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:38.616438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:38.617111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:38.623523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.624002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.624439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.625153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.625607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.626030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.644761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:38.757333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:38.765043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-652e9ca7-2a3c-475b-a015-757a971635f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.152605 Sep 19 15:20:38.765584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 424/962] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:20:38.770778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:38.771378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:38.776953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.777438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.777870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.778566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:38.779004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:38.779419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:38.842455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:20:38.850606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ccb1d1cd-e72f-4070-b93a-f0591338a8aa tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.084090 Sep 19 15:20:38.851159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 425/963] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:20:38 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:20:39.831596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:20:39.832167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:20:39.837955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:39.838443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:39.838887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:39.839587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:20:39.840048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:20:39.840499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:20:40.464471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:20:40.465090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:20:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:20:43.706284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:20:43.706858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:20:43.712886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:20:43.713015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:20:49.835545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=15 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:20:49.860842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=12 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:39.777336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:21:40.158994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:21:49.812455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=4 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:21:50.164763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=4 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:22:23.711658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:22:23.712381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:23:06.446913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:23:06.449277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:23:06.450742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:23:06.451638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:23:06.461493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:06.464078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:23:06.465929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) Sep 19 15:23:06.467295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:23:06.468944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c45c2ede-a0a4-46b1-a62c-f3546ebbfaef) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:23:06.468944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dff28ec8-d795-4db0-a0a0-0f886b54786d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 146.688566 Sep 19 15:23:06.468944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 426/964] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:20:39 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 146690 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:23:06.475718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR oslo.messaging._drivers.impl_rabbit [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [5b82e167-c360-480d-ad50-3b2cd8b3950b] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:23:06.529729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:06.530371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:06.537480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.537966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.538406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.539105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.539564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.539988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.684969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:06.693679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e9afe1f7-f797-4c2a-b61a-a558022eeb80 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.241022 Sep 19 15:23:06.694244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 427/965] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:06.745742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:06.746359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:06.752402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.752925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.753493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.754401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.755035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.755466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.816125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:06.823900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ef61471f-0891-47a8-b3cb-97ecb0fdb743 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.128623 Sep 19 15:23:06.824398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 428/966] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:06 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:06.829000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:06.829495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:06.835344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.835827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.836266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:06.836999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:06.837458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:06.837888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.482215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [5b82e167-c360-480d-ad50-3b2cd8b3950b] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 50230. Sep 19 15:23:07.485597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-557ddffc-946f-4766-847c-d702aba1fcff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 202 len: 0 microversion: 2.1 time: 207.784853 Sep 19 15:23:07.486208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 539/967] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:19:39 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 0 bytes in 207786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:23:07.492342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:07.493107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:07.500027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.500537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.500979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.501683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.502144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.502570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.639782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:07.648160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3fe39977-3f4d-4b90-aa5f-0a7419a6c6ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160862 Sep 19 15:23:07.653530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 540/968] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:07.653530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:07.653724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:07.658958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.659436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.659864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.660564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.661624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.662043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.721986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:23:07.729728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4a6118b5-e2a4-4fbe-8cbc-52103b023829 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.080012 Sep 19 15:23:07.730284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 541/969] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:23:07 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:23:07.734632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:07.735091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:07.740696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.741170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.741626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.742300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.742742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.743154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.768011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:23:07.969184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f6459fd9-a5cb-4fe1-b849-8756f217480c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 204 len: 0 microversion: 2.20 time: 0.237636 Sep 19 15:23:07.969759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 542/970] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:23:07 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:23:07.974945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:23:07.975515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:23:07.981186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.981659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.982087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:07.982776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:23:07.983221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:23:07.983634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:23:16.833002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:16.856145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=16 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:17.978719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:18.003136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:40.650832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:23:40.698713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:23:50.662720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=4 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:23:50.702473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=4 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:24:00.469791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:24:00.470446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:24:00.472848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:24:00.472970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:24:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:24:03.717958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:24:03.718535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:24:03.720803 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:24:03.720965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:25:07.161288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:25:07.163574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:25:07.165405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:25:07.166566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:25:07.168098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.169646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:25:07.170877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) Sep 19 15:25:07.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.173314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-204abb7f-c31e-4fea-aecf-30bf434d9f0b) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:25:07.173314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d165f64e-4531-4bed-9a23-1180b92699d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 120.339805 Sep 19 15:25:07.173314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 429/971] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:23:06 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 120341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:25:07.173314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:25:07.173690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:25:07.178114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.178594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.179138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.179834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.180286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.180829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.205526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:25:07.414240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a8c718a5-e603-4e22-9176-a8ba4e430d1c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 202 len: 0 microversion: 2.1 time: 119.443102 Sep 19 15:25:07.414862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 543/972] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:23:07 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 0 bytes in 119445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:25:07.420925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:25:07.421511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:25:07.428736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.429328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.429770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.430482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.430933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.431361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.528854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d37ffd52-2f6b-46fa-881c-7c0f234f2125 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 204 len: 0 microversion: 2.1 time: 0.361748 Sep 19 15:25:07.529355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 430/973] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:25:07 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:25:07.534479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:25:07.535885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:25:07.542425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.542903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.543335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.544016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.544464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.544904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.683100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:25:07.690824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-37a791ab-90c3-4dba-b4c7-262eef3a835b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.160330 Sep 19 15:25:07.691378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 431/974] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:25:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:25:07.696446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:25:07.697084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:25:07.702510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.702999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.703438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.704133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.704630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.705058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.765389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:25:07.773792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b5327269-c127-4966-b0f2-404c83c4e3a7 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.081432 Sep 19 15:25:07.774356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 432/975] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:25:07 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:25:07.779417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:25:07.779417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:25:07.784964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.785447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.785883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.786567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.787024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.787497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.800504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:25:07.802152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:25:07.803868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:25:07.805039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:25:07.806674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:25:07.808198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:25:07.808198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-71e6bf6f-cdc3-4378-9460-50eba135d6d6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.028378 Sep 19 15:25:07.808198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 433/976] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:25:07 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:25:07.808545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:25:07.809067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:25:07.814434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.814910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.815340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:07.816026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:25:07.816512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:25:07.816931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:25:17.427661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:17.452913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:17.813864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:17.837706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:25:40.876795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:25:43.724541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:25:43.725165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:25:50.881583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=4 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:07.630337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:27:17.635013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=4 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:20.475582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:27:20.476186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:27:20.485555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:27:20.485731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:27:20.487051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:27:20.487187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:27:23.730502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:27:23.731186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:27:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:27:40.993016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:27:40.995547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:27:40.996958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:27:40.997721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:27:40.998815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:40.999998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:27:41.001131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) Sep 19 15:27:41.002296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1950cf-9543-4b5d-a4b1-89837e359ba2) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 153.581044 Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:27:40 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (10.222.0.75) Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-58f0236e-89ef-4500-9bde-2b16cecd594b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Unhandled error: OSError: write error Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:27:41.003598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:27:41.004195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 544/977] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:25:07 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 0 bytes in 153583 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:27:41.169617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:41.170118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:41.176134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.176666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.177125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:41.177834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.178291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.178749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:41.193801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:27:41.195395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:27:41.197072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:27:41.198039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:27:41.199531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:27:41.201064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:27:41.201064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c36492b8-c866-4187-853a-70bc621fc40b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.197696 Sep 19 15:27:41.201064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 545/978] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:27:40 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:27:41.201631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:41.202118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:41.207554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.208022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.208456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:41.209169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.209622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.210045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:41.235358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:27:41.499787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-94665804-f414-4350-9427-9fe113c2fad1 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 204 len: 0 microversion: 2.1 time: 0.301241 Sep 19 15:27:41.500388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 546/979] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:27:41 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:27:41.558827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-5972d136-15f9-4094-8655-c7b5aff53b58 req-ea783485-2a37-4f4b-b24c-07402e6f5aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94201d17-c5c8-44d8-b1ea-5cec58d30ede", "name": "network-vif-deleted", "tag": "102d73ca-2eef-4409-9398-a9a28b924ce4"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:27:41.568821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5972d136-15f9-4094-8655-c7b5aff53b58 req-ea783485-2a37-4f4b-b24c-07402e6f5aba service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.569295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5972d136-15f9-4094-8655-c7b5aff53b58 req-ea783485-2a37-4f4b-b24c-07402e6f5aba service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.569803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5972d136-15f9-4094-8655-c7b5aff53b58 req-ea783485-2a37-4f4b-b24c-07402e6f5aba service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:41.581727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-5972d136-15f9-4094-8655-c7b5aff53b58 req-ea783485-2a37-4f4b-b24c-07402e6f5aba service nova] Creating event network-vif-deleted:102d73ca-2eef-4409-9398-a9a28b924ce4 for instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede on hv-cinder-75671 Sep 19 15:27:41.587142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-5972d136-15f9-4094-8655-c7b5aff53b58 req-ea783485-2a37-4f4b-b24c-07402e6f5aba service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085154 Sep 19 15:27:41.587727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 547/980] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:27:41.592891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:27:41.593468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:27:41.599493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.599973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.600444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:41.601169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:27:41.602296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:27:41.602727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:27:51.597400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:27:51.620672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:03.734854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:29:03.735478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:29:07.724502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:07.726655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:07.728291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:07.729254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:07.730919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:07.734957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:07.736535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) Sep 19 15:29:07.738536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-620671f6-3c89-42d6-8b8c-9a8d05d1a63d) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 239.923064 Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:07 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (10.222.0.75) Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-e93587cd-bfb0-41d1-9e47-d6bc46c0acc6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Unhandled error: OSError: write error Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:07.740349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:07.740977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 434/981] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:25:07 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 0 bytes in 239925 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:07.862814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:07.863440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:07.870560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:07.871043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:07.871481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:07.872170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:07.872659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:07.873084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.005318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:08.015700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.285205 Sep 19 15:29:08.016312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:29:08.016312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:08 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (10.222.0.75) Sep 19 15:29:08.016989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-4ea0c72b-7bac-4e57-9052-df98de56625a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Unhandled error: OSError: write error Sep 19 15:29:08.016989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:08.016989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:08.017262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 435/982] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 0 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:08.139966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:08.139966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:08.145999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.146538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.146979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.147678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.148141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.148597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.211127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1225 microversion: 2.1 time: 0.200873 Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 (ip 10.222.0.75) !!! Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:08 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 (10.222.0.75) Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-7b88702b-5671-4944-9058-9d6cf0bb706f tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Unhandled error: OSError: write error Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:08.226524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 436/983] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:08 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 0 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:08.339064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:08.339635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:08.345578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.346067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.346505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.347198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.347693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.348124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.361040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:08.362582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:08.364219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:08.365139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:08.366614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.142906 Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede (ip 10.222.0.75) !!! Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:08 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede (10.222.0.75) Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-12af710f-15eb-44f1-92c8-9cb5fce80a82 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Unhandled error: OSError: write error Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:08.368350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 437/984] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:08 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 0 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:08.369726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:08.370209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:08.376120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.376631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.377069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:08.377751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:08.378209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:08.378636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:18.373803 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=8 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:18.397054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=18 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:41.110924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:41.191447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:41.267302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:41.269803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:41.271488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:41.272359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:41.273715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.275256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.276457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) Sep 19 15:29:41.278021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c9c70d-7c77-4735-b732-83cbd5d57ca1) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 119.682556 Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (10.222.0.75) Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-5fae0c12-b21a-48c0-a7c6-4891b67dce08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Unhandled error: OSError: write error Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:29:41.279294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:29:41.279888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 548/985] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:27:41 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 0 bytes in 119684 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.279888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.279888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.289069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.291075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.291075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.291075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.291386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.291535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.308918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:41.311537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.313181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.314084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.318086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.319427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.320127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.046617 Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:41.321927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:41.323413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:41.324063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:41.325142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.326270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.327271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) Sep 19 15:29:41.328799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.329970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 (ip 10.222.0.75) !!! Sep 19 15:29:41.329970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 (10.222.0.75) Sep 19 15:29:41.329970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-0ff63930-fafd-4898-bde2-e2d4d928e8b6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Unhandled error: OSError: write error Sep 19 15:29:41.329970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:29:41.329970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:29:41.329970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 549/986] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 0 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.333312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a5e948f-c61f-4f53-9492-1d513bea6bd8) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.334195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 32.968233 Sep 19 15:29:41.334913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:29:41.334913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (10.222.0.75) Sep 19 15:29:41.335676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-4e1b17bc-6e52-4e34-9316-40c56d377abf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Unhandled error: OSError: write error Sep 19 15:29:41.335676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:41.335676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:41.335911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 438/987] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:08 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 0 bytes in 32970 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.340988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.341479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.348621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.349169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.349601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.351016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.351473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.351896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.439501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:41.497947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.498452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.498995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:41.501212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:41.502847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:41.503580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:41.504878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.506582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.507840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) Sep 19 15:29:41.509154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.510358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.510358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.510358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.510358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.510699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.510699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61bcc21-004c-45cf-a009-31af478b2338) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 0.176886 Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (ip 10.222.0.75) !!! Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 (10.222.0.75) Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-b9ddbf22-cad5-420f-8261-73dfac4a7bb9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Unhandled error: OSError: write error Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:41.516666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:41.517320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 439/988] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 0 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.520700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.521308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.523220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:41.524816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.526494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.527416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.528974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.530431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.530431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.202201 Sep 19 15:29:41.530431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 (ip 10.222.0.75) !!! Sep 19 15:29:41.530431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 (10.222.0.75) Sep 19 15:29:41.530784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.530890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-c6aaa373-2769-47b4-ae9b-2c3eb21db813 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Unhandled error: OSError: write error Sep 19 15:29:41.530890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:29:41.530890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:29:41.530890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 550/989] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 0 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.531198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.531198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.531198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.531198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.531545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.531712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.532319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.539173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.539652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.540253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.541192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.541807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.547772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.575744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.576926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.577781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.578326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lazy-loading 'fault' on Instance uuid 609cf815-b2a9-4258-82a9-29d7eded8012 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:41.635125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:41.642751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1230 microversion: 2.1 time: 0.114477 Sep 19 15:29:41.645248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 (ip 10.222.0.75) !!! Sep 19 15:29:41.645248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 (10.222.0.75) Sep 19 15:29:41.645248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-c6bbc90d-d519-4bbc-8021-7c68b02d7a92 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Unhandled error: OSError: write error Sep 19 15:29:41.645248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:29:41.645248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:29:41.645248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 551/990] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:41 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.648564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.649022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.654713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.655183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.655616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.656301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.656868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.657290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.670715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:41.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:41.680895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.681652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:41.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.028914 Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede (ip 10.222.0.75) !!! Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede (10.222.0.75) Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-86d33bd1-0718-4db8-a8d9-ea70d3233012 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Unhandled error: OSError: write error Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:29:41.684098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 552/991] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.684699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.684699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.686358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.687140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.687279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.687927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.688371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.688819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.699444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:41.709013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1559 microversion: 2.1 time: 0.193259 Sep 19 15:29:41.709582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:29:41.709582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (10.222.0.75) Sep 19 15:29:41.710164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-9d9577f3-4862-4c5d-812f-cf30893bd12c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Unhandled error: OSError: write error Sep 19 15:29:41.710164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:41.710164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:41.710402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 440/992] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 0 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.728112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.728657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.749684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.750186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.750669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.751388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.751845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.752276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.767818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:41.769500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.771084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.771840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:41.773188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.060138 Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 (ip 10.222.0.75) !!! Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:29:41 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 (10.222.0.75) Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: CRITICAL nova [None req-d6fa0a09-628e-495a-9978-0caf600f1ee8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Unhandled error: OSError: write error Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova OSError: write error Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova Sep 19 15:29:41.774419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 441/993] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 0 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:41.777101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.777741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.783678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.784165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.786064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.786948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.787447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.788081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.794692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:41.803269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:41.804859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.806180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:41.806906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:41.809687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:41.813464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:41.813464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e894fcb7-df94-4b50-b29c-a1e299a500bf tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.032788 Sep 19 15:29:41.813464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 442/994] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:41.816655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:41.817305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:41.823533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.824283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.824900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.825875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:41.826323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:41.826713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:41.927233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:41.993596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:41.995799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:41.999522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.000424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.001856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.003254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.004395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) Sep 19 15:29:42.005849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.007103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8448d09a-4871-4c08-ab71-2407b3624f14) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.007103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-292d6998-4d02-475d-a1c8-61f63a0275de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 0.186382 Sep 19 15:29:42.007103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 443/995] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.007103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.007475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.012820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.013260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.013659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.014356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.015041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.015472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.051635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.053232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:42.054828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.055640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.056895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.058309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.059529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) Sep 19 15:29:42.060987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f48df0a2-c362-4c77-928f-c79d77985dee) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 0.378975 Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (ip 10.222.0.75) !!! Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:29:42 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a (10.222.0.75) Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: CRITICAL nova [None req-fc5a861b-5447-4ff9-9256-f46c187b36c2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Unhandled error: OSError: write error Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova OSError: write error Sep 19 15:29:42.062201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova Sep 19 15:29:42.063081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 553/996] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:41 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 0 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 19 15:29:42.063081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.063081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.067454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.067932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.068369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.069107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.069566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.069986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.111718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.111718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.111718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.111718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lazy-loading 'fault' on Instance uuid 609cf815-b2a9-4258-82a9-29d7eded8012 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:42.175935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0121ba668034aac98863a2caf80320e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cfaa7a9ec843e1a26460270f99a9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:42.183101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-131e070d-d472-4b23-9a96-2c998f7886d8 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 200 len: 1184 microversion: 2.1 time: 0.126357 Sep 19 15:29:42.183663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 554/997] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:42 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 1184 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:42.188344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.188860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.195871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.199680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.199680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.199680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.199680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.200168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.211988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.213610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.216125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.217634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.219314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.219314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f08f9a0b-1c82-4f8c-91aa-e7da1960baab tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.030271 Sep 19 15:29:42.219314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 555/998] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.220187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.220517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:42.221159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.227296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.228300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.228300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.229131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.229395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.229732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8c4d7eed-a81d-45db-bd7e-60238a2439a3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1559 microversion: 2.1 time: 0.230920 Sep 19 15:29:42.229923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.230298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 444/999] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:42.235516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.236083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.243011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.243513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.243952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.244922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.245388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.245963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.260422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:42.262010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.263408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.264244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.265591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.266825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.266825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-38a1183f-085a-4d3a-82c1-aa14e38b5e26 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.031845 Sep 19 15:29:42.266825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 445/1000] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:42.269306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.269632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.275485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.275974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.276990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.278121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.278866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.279622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.298466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:42.300088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.302205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.302945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.304132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.307739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.307739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea3300d8-19c6-4073-9611-d1af1ea44baa tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.036538 Sep 19 15:29:42.307739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 446/1001] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:42.318432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.319200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.326391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.326892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.327334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.328046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.328652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.329289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.345600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:42.419164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:42.446434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.448379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:42.450081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.451198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.452495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.454008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.455284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) Sep 19 15:29:42.456858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.458717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f96f3cee-34ef-42bd-9ec0-5f247912252b) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.458717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-39a7f2af-3514-4a15-b06c-d0ade6735d13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 0.233448 Sep 19 15:29:42.458717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 556/1002] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 269 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.458717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.459125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.462356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.462837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.463263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.463986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.464427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.464892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.489169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:42.491460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:42.494729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.496043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.497452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.498869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.502568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) Sep 19 15:29:42.503804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.504921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8d750bc-27bd-4a4c-9b0a-574cb0349b2b) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.504921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-df34955d-c7bd-4063-a4f4-a1aa9caf2cd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 0.187493 Sep 19 15:29:42.504921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 447/1003] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.504921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.505389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.508955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.513927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.513927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.513927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.513927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.514814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.530259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 HTTP/1.1 Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:42.533116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.534504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '609cf815-b2a9-4258-82a9-29d7eded8012'} Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.537987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.539285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.540661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 404 to user: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.540661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dbec8b5b-5705-4eee-ae56-8faff090e481 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 404 len: 111 microversion: 2.1 time: 0.040016 Sep 19 15:29:42.540661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 448/1004] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:42 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:42.542755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.543354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.549725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.550320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.551495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.552429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.553108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.553533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.571771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:42.576875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.578289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.579074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.580291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.582099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.582099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ee9778d5-6fd1-493e-966d-4db5f43146a0 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.042057 Sep 19 15:29:42.582099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 449/1005] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.587463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.589641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.593955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.594437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.594900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.595608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.596148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.596607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.634320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:42.642294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ec1cefbb-3be4-4b47-b6fb-63ad09f54511 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1559 microversion: 2.1 time: 0.190643 Sep 19 15:29:42.642870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 557/1006] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:42.652408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.652943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.664041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.664530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.665637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.666155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.666611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.667219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.683542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.685229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.686656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.687469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:42.688681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.689906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.689906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-27e7f125-79d1-48a0-8ec8-3c6c5aa4942c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.042780 Sep 19 15:29:42.689906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 558/1007] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:42.690980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:42.693243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.693834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.701270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.701270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.701270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.701270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.701727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.702107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.715714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.717294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.718689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.719430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:42.720670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.724195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.724195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c2b7b8ca-28a2-4cec-89e9-061f3e90bd4e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.030168 Sep 19 15:29:42.724195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 559/1008] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:42.725044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.725549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.731334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.731814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.732249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.732978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.733428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.733857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.754719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:42.757804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:42.759198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.759870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.760898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.762031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.763088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) Sep 19 15:29:42.764196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.765604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3777638a-3956-40af-b7cf-180c5555b57d) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.765604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-79dcc66c-28ca-422c-a432-f606533e9c45 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 0.176113 Sep 19 15:29:42.765604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 450/1009] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 269 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.765604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.765962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.771946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.772551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.772896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.773599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.774055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.774807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.821678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:42.882563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.884766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:42.886380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.887068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:42.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.890047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.892224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) Sep 19 15:29:42.894748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.898722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76e3fe35-8d8b-4bd5-afee-e3599c3a0ef0) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.898722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e9810c2d-421f-486e-9951-c92a0f0f3ba8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 0.165892 Sep 19 15:29:42.898722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 560/1010] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.898722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.899264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.900150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.900404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.900872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.901571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.902021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.902442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.918680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 HTTP/1.1 Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.920470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '609cf815-b2a9-4258-82a9-29d7eded8012'} Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.929369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:42.930789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.932098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 404 to user: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.932098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c1df3638-e07d-4503-b4bf-01393523f75a tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 404 len: 111 microversion: 2.1 time: 0.034323 Sep 19 15:29:42.932098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 561/1011] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:42 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:42.932098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.932098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.942081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.942666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.943117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.943846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.944751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.945181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.949699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:42.957989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7a16ef39-85bf-427f-bbb0-4cb5fa4d90b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1559 microversion: 2.1 time: 0.196573 Sep 19 15:29:42.958627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 451/1012] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:42.961912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:42.963699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.965171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:42.965907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:42.967104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:42.968750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.968750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.969050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:42.971950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.972160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-643c0025-ac9a-4bfd-967c-22d65df30c14 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.046470 Sep 19 15:29:42.972971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.973198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 562/1013] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:42.973858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.974576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.975162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.975672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.978271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:42.982312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:42.989704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.990190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.990624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:42.991328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:42.991773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:42.992225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.006854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.008404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.009845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.010633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.011836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.013185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.013185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c9d7da3b-4abb-4540-849b-1ed69a533c68 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.035730 Sep 19 15:29:43.013185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 563/1014] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.015082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a37d13a-b506-47f9-9473-9263fa583258", "name": "network-vif-deleted", "tag": "09b225b1-fd59-4d43-934b-bf41d463c818"}, {"server_uuid": "f55f8598-7398-40de-a1b8-e54986ebcdc9", "name": "network-vif-deleted", "tag": "f7d13ef8-b77b-418b-b4ac-c99317b7c283"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:43.026453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.026927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.027354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.050478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] Creating event network-vif-deleted:09b225b1-fd59-4d43-934b-bf41d463c818 for instance 0a37d13a-b506-47f9-9473-9263fa583258 on hv-cinder-75671 Sep 19 15:29:43.051480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] Creating event network-vif-deleted:f7d13ef8-b77b-418b-b4ac-c99317b7c283 for instance f55f8598-7398-40de-a1b8-e54986ebcdc9 on hv-cinder-75671 Sep 19 15:29:43.059994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-5670e0ff-ea36-45bc-9629-162c0f5632a9 req-c1ce5b29-8122-40cf-b1aa-55a3a7093b9c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048177 Sep 19 15:29:43.063800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 564/1015] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:43.070261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.070845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.077804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.078279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.078489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:43.078710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.079400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.079846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.080261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.093935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.095636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.097928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.099078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.101713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.104600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.104600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f44bafd-5efd-40f4-bc02-c31e773a234f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.031944 Sep 19 15:29:43.104600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 565/1016] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.104600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.104600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.109171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.109639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.110064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.110742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.111177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.111590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.138819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:43.141260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:43.142882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.143637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.145398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.146750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.148076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) Sep 19 15:29:43.149954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.153195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74fe251b-7c16-407f-b407-d56ec4b0a56d) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.153195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0992e688-a611-4fc2-ba3c-791d1b3f2e7c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 0.182916 Sep 19 15:29:43.153195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 452/1017] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:42 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 269 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:43.153195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.153619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.157517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.160518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.160518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.160518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.160518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.160892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.208300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:43.269953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.271446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:43.272824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.273439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.274497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.275610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.276674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) Sep 19 15:29:43.277731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.278764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-06deda2d-b2f7-4b17-9a29-00ab0f1f1c41) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.278764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9961e7ba-20da-4906-98db-c9754cb83dd1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 0.173618 Sep 19 15:29:43.278764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 566/1018] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:43.278764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.279070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.285781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.286338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.286773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.287472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.287915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.288330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.303274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 HTTP/1.1 Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.304843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.306214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '609cf815-b2a9-4258-82a9-29d7eded8012'} Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.307134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.308363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.309595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 404 to user: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.309595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f8a9debc-8bb5-441b-b674-6be51557dcbd tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 404 len: 111 microversion: 2.1 time: 0.031802 Sep 19 15:29:43.309595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 567/1019] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:43 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.309806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:43.311193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.311689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.316959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-122fd293-98a8-4341-a8d8-764ed21ce3da tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1559 microversion: 2.1 time: 0.172333 Sep 19 15:29:43.317603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.317833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 453/1020] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:43.318504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.319180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.319937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.320388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.325900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.326177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.326177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.331772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.332281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.332723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.333424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.333878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.334297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.335457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.337819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.339339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.341880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.343222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.345852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.345852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b1251cf8-282c-4025-89b8-0895185224d2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.031508 Sep 19 15:29:43.345852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 568/1021] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:43.345852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.345852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.351167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.351765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.352087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.352787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.353239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.353696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.369494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.371103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.372448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.373208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.375060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.377937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.377937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-937753b7-338e-42f9-968e-5475de213cba tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.031967 Sep 19 15:29:43.377937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 569/1022] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.377937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.378569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.384243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.384786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.385227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.385920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.386464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.386854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.401691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.403710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.405075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.405798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.407088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.408442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.408442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0e5e38b9-f9f9-43e4-86b9-af53ad255b9e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.031293 Sep 19 15:29:43.409549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 570/1023] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.414706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.415701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.422487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.422967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.423395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.424088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.424626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.425048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.429568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:43.485315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:43.487648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:43.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.490909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.492021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.494198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.495890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) Sep 19 15:29:43.500811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.502428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-405bb5d4-de26-466d-bd22-32a85aa7c430) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.502428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3aa2cf91-85a9-4432-903a-e0ac83977400 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 0.171722 Sep 19 15:29:43.502428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 454/1024] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 269 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:43.502428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.502786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.505759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.506268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.506703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.507393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.507842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.508263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.548620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:43.621823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 HTTP/1.1 Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.624118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:29:43.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': '2751262b-7323-4c6a-b3f1-830fb2448558', 'id': 'f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4'} Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.626235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:43.627259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.629582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.631894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) Sep 19 15:29:43.634597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.639027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95635bc3-ae55-4c48-a5f4-17ae9f65dc49) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.639027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5f4c0537-72a9-4644-afbf-fc6e322ec48c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4" status: 400 len: 269 microversion: 2.1 time: 0.215778 Sep 19 15:29:43.639027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 571/1025] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments/f29cc0e8-0b2a-4b97-9b59-53ab7b3e71e4 => generated 269 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:43.639027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.639652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.641752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.642296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.643092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.643885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.644863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.645277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.651576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:43.659255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0af6ea62-c278-4a88-ae16-6d4784ea8676 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1559 microversion: 2.1 time: 0.167494 Sep 19 15:29:43.660613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 455/1026] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:43.664747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 HTTP/1.1 Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:43.666190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.667493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '609cf815-b2a9-4258-82a9-29d7eded8012'} Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.668209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:43.669455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.671575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 404 to user: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.671575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-268c77e0-adf8-41cc-b108-49b31b2e4938 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 404 len: 111 microversion: 2.1 time: 0.038404 Sep 19 15:29:43.671575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 572/1027] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:43 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.673127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.673618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.675927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.677384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.688594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.689080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.689729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.690629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.691471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.692087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.694343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.694861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.695486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.697064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.697543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.697979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.704261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:43.711228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:43.713277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.714636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.715359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:29:43.716577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.719295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.720340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-be05f7eb-8637-4bbf-b977-a465621df0d8 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.058929 Sep 19 15:29:43.721436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 456/1028] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:43.728557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.729392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.736901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.737563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.738359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.739254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.739866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.740610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.761013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:43.762971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.764293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.765050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:29:43.766237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.768314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.769895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b7245709-da91-4866-872d-b02e3b5d4be7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.045991 Sep 19 15:29:43.775642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 457/1029] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.779694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.780228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f55f8598-7398-40de-a1b8-e54986ebcdc9] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.788417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.789050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.789741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.790904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.791549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.792163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.798693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:43.810547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 HTTP/1.1 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:43.812440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.813832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'f55f8598-7398-40de-a1b8-e54986ebcdc9'} Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:43.814570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. Sep 19 15:29:43.817086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:43.819178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f55f8598-7398-40de-a1b8-e54986ebcdc9 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:43.819178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-41301c3e-96f6-4662-90a3-69acab67c546 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9" status: 404 len: 111 microversion: 2.1 time: 0.042222 Sep 19 15:29:43.819178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 458/1030] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:43 2022] GET /compute/v2.1/servers/f55f8598-7398-40de-a1b8-e54986ebcdc9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:43.820335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.822442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:43.830643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.830643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.830643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.830643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:43.831285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:43.831285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:43.864577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-91f946cd-6b67-444a-8994-1e02b008bcbe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048289 Sep 19 15:29:43.865315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 459/1031] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:43.870503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-152ea271-5c25-4c32-9b66-21ffdb1a085e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '.version_select at 0x7f41fb60e4c0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:43.949594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-152ea271-5c25-4c32-9b66-21ffdb1a085e tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-154904036" status: 204 len: 0 microversion: 2.20 time: 0.083071 Sep 19 15:29:43.951224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 460/1032] 10.222.0.75 () {60 vars in 1259 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-154904036 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:29:43.967324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-18802d2b-f549-40e9-a4cb-874f9d0d24a9 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '.version_select at 0x7f41fb5d31f0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:44.058343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-18802d2b-f549-40e9-a4cb-874f9d0d24a9 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911129086" status: 202 len: 0 microversion: 2.1 time: 0.096285 Sep 19 15:29:44.059841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 461/1033] 10.222.0.75 () {58 vars in 1221 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911129086 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:29:44.066930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-52367256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2133944848", "security_groups": [{"name": "tempest-secgroup-smoke-1283070169"}], "block_device_mapping_v2": [{"uuid": "54a586e4-eed8-4e82-9223-685acb773fd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e9db59a0-d876-403f-9298-cf2d31bb4ecb"}]}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:44.546277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lazy-loading 'services' on Instance uuid ed221b61-f2e4-4a1c-88db-8ee956c45e7a {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:29:44.717741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] validate_networks() for [('e9db59a0-d876-403f-9298-cf2d31bb4ecb', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:29:44.730698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Request method failure captured: Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a HTTP/1.1 Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIadnOoob6ialj1x7-8JEACJX-syOE9USsrCZdYebPiWk_lxOqbVagbKJk8S7TOM2StobadScHm92622lPZuyDVoBcX4m7n2ytK4AF92EWhW2yy159OLrCAf4D90pewGJMYAYa9VpfMCYNPKUGuyYlMZ9uacQPsn3qOeE-pAImpmX9w Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:29:44.732964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f1bbde55bafa42108676212642d7d3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f1bbde55bafa42108676212642d7d3bd"}]}] Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: f1bbde55bafa42108676212642d7d3bd Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74002691 Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 0b4ee04a6c6d42fd9bc97d5e356d4a0a Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesSnapshotTestJSON-74002691-project Sep 19 15:29:44.734291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'server_id': 'ed221b61-f2e4-4a1c-88db-8ee956c45e7a', 'id': '99126f62-c0bd-413a-a64c-5903c85c602a'} Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:44.734990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:44.735990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:44.737237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:44.738295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) Sep 19 15:29:44.739364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:29:44.740382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-35939302-6843-402c-b573-571f3bdc83fb) {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:44.740382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-21166c60-e092-473c-a8f0-dfae4495a89e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a" status: 400 len: 269 microversion: 2.1 time: 1.065104 Sep 19 15:29:44.740382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 573/1034] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:29:43 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a/os-volume_attachments/99126f62-c0bd-413a-a64c-5903c85c602a => generated 269 bytes in 1071 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:44.745812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7b86bced-50e0-48d5-9ed0-be53d6d121be tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '.version_select at 0x7f41fec98280>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:44.891896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7b86bced-50e0-48d5-9ed0-be53d6d121be tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-447865486" status: 202 len: 0 microversion: 2.1 time: 0.150467 Sep 19 15:29:44.892941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 574/1035] 10.222.0.75 () {58 vars in 1218 bytes} [Mon Sep 19 15:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-447865486 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:29:44.905106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:44.905106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:44.910432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:44.911053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:44.911757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:44.912740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:44.913405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:44.913940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:44.947864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0cc15b53-e09c-410f-a19b-c48edfec2be5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053275 Sep 19 15:29:44.949032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 575/1036] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:45.386523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5e8cdaff-abb9-46a8-b746-57ca7298f4ac tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Action: 'create', calling method: .version_select at 0x7f41fecd4ee0>, body: {"keypair": {"name": "tempest-keypair-1837030334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1lX6c8uvZuwga15MS3928gfhE4pryeyVxuBZFSK5P6rWS4YTsm4taFLRHhM1NcMAupJjMnxCX3RsmDaYvJ4VvLRydoEmR5J3Rn2oopHAJXzVBDjRf6zXKqDGGI37U1gQ=="}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:45.415248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-5e8cdaff-abb9-46a8-b746-57ca7298f4ac tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for project c727384d4ff043809f8421840cbd7596. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:29:45.419943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-5e8cdaff-abb9-46a8-b746-57ca7298f4ac tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for user 833edf46ef9b4d3982ce49abc74933a2 and project c727384d4ff043809f8421840cbd7596. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:29:45.534459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5e8cdaff-abb9-46a8-b746-57ca7298f4ac tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153862 Sep 19 15:29:45.536061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 576/1037] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:29:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:45.544566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:45.545168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:45.553369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:45.553989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:45.554404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:45.555202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:45.555821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:45.556565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:45.588381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:29:45.690255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:29:45.691044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:29:45.691629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:29:45.692828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:29:45.694025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:29:45.716637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:45.718937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:45.720795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:45.724829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:45.726643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:45.727319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:45.785190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Getting quotas for project 44cfaa7a9ec843e1a26460270f99a9e2. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:29:45.790611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Getting quotas for user c0121ba668034aac98863a2caf80320e and project 44cfaa7a9ec843e1a26460270f99a9e2. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:29:45.863448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:29:45.865810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: bd7b5a74-87d8-4200-8a23-59590c6ee0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54a586e4-eed8-4e82-9223-685acb773fd7',volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:29:45.982534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9c916c8f-657c-4579-81af-dc30a55a9865 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "DELETE /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 204 len: 0 microversion: 2.1 time: 0.445319 Sep 19 15:29:45.986242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 577/1038] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:45 2022] DELETE /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:29:46.014984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 476 Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:46.018361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:46.020648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {"server": {"name": "tempest-TestVolumeBootPattern-server-52367256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2133944848", "security_groups": [{"name": "tempest-secgroup-smoke-1283070169"}], "block_device_mapping_v2": [{"uuid": "54a586e4-eed8-4e82-9223-685acb773fd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e9db59a0-d876-403f-9298-cf2d31bb4ecb"}]}} Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-52367256', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-2133944848', 'security_groups': [{'name': 'tempest-secgroup-smoke-1283070169'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '54a586e4-eed8-4e82-9223-685acb773fd7'}], 'networks': [{'uuid': 'e9db59a0-d876-403f-9298-cf2d31bb4ecb'}]}}} Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:46.021324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:46.021999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1971, in _validate_bdm Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5003, in _check_attach_and_reserve_volume Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:29:46.023152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 15:29:46.026325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1550, in _provision_instances Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 15:29:46.027398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise self.value Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1460, in _provision_instances Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1866, in _bdm_validate_set_size_and_instance Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._validate_bdm( Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1980, in _validate_bdm Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:46.028719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:46.029808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:46.030975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) Sep 19 15:29:46.030975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.030975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 54a586e4-eed8-4e82-9223-685acb773fd7 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0943504a-6d25-4330-a706-0217b3a3eac0) {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:46.030975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-480b402f-37e3-48da-91ad-c03bed1d9443 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.959420 Sep 19 15:29:46.030975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 462/1039] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:29:44 2022] POST /compute/v2.1/servers => generated 295 bytes in 1960 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:29:46.031391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-05ac4796-c4f4-42d2-9f0a-4b2c99335958 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Action: 'create', calling method: .version_select at 0x7f41fb7123a0>, body: {"keypair": {"name": "tempest-keypair-1814560511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgV9DqG4Ke56V6pMJCAvn2pw7kSwxewnfaYF/NFU7wXVjskfxu0x7v9yQpMwWMErMPjow6VwRA9Iqp0NB6x4Vy2h9ABXg3v8l3Zl75vzZZnZOvFwvOX/UGbBRu+jzPf1A=="}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:46.048289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-05ac4796-c4f4-42d2-9f0a-4b2c99335958 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:29:46.053069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-05ac4796-c4f4-42d2-9f0a-4b2c99335958 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for user 808156c7457b4e8b9b6c5f305755b3f3 and project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:29:46.155212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-e39bff70-20e4-4619-94fa-5f4ee90914b2 req-699b7c92-4ff9-4767-b337-7d50a6ee85df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31955ace-a21d-4a42-8e97-33da4bca71f0", "tag": "a7905d0d-ddbc-4310-b98e-9d7db60cfd0d"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:46.169520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-e39bff70-20e4-4619-94fa-5f4ee90914b2 req-699b7c92-4ff9-4767-b337-7d50a6ee85df service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.169996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-e39bff70-20e4-4619-94fa-5f4ee90914b2 req-699b7c92-4ff9-4767-b337-7d50a6ee85df service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.170446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-e39bff70-20e4-4619-94fa-5f4ee90914b2 req-699b7c92-4ff9-4767-b337-7d50a6ee85df service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.183450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-05ac4796-c4f4-42d2-9f0a-4b2c99335958 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.161305 Sep 19 15:29:46.184113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 463/1040] 10.222.0.75 () {62 vars in 1200 bytes} [Mon Sep 19 15:29:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 15:29:46.189206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:46.194193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:46.208861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-e39bff70-20e4-4619-94fa-5f4ee90914b2 req-699b7c92-4ff9-4767-b337-7d50a6ee85df service nova] Creating event network-changed:a7905d0d-ddbc-4310-b98e-9d7db60cfd0d for instance 31955ace-a21d-4a42-8e97-33da4bca71f0 on hv-cinder-75671 Sep 19 15:29:46.210303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.213045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.213816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.214770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.216866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.217854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.223917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-e39bff70-20e4-4619-94fa-5f4ee90914b2 req-699b7c92-4ff9-4767-b337-7d50a6ee85df service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235817 Sep 19 15:29:46.225917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 578/1041] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:46.252187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:46.253074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:46.268723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.271721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.273056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.273804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.276708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.277198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.302461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cfac03c2-a8c6-4b89-93fa-eaddca7e160d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117175 Sep 19 15:29:46.304112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 464/1042] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:46.794030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:46.794758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:46.801171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.801735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.802177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.802939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.803398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.803824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.819991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 HTTP/1.1 Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:46.821751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.823103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '609cf815-b2a9-4258-82a9-29d7eded8012'} Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:46.823917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.825526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.826771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 404 to user: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:46.826771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4f0e20c0-e987-4bac-a600-db7866fc8baf tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "DELETE /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 404 len: 111 microversion: 2.1 time: 0.033628 Sep 19 15:29:46.827732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 465/1043] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:29:46 2022] DELETE /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:29:46.830061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:46.833908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:46.835304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] [instance: 609cf815-b2a9-4258-82a9-29d7eded8012] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:46.843034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.843541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.844217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.845135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:46.845597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:46.849012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:46.852934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a15f43f8-ed6d-4a3b-ad6e-306b00905dde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1565 microversion: 2.1 time: 0.625558 Sep 19 15:29:46.853763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 579/1044] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1565 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:46.869955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] HTTP exception thrown: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Request method failure captured: Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 HTTP/1.1 Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIbPxC7BycvgK9TO95zMhFaBCEZT9-bbKQp4v8Jav7w4L_8a5jzyumNaLVFrHSxTbRTtFtYhfABQQGbrEjLtugWwyel-hBFmEZZM4Wn-eYeHlyGcodVUVZhc9LkEF2xm0DRM8iiFHFB22O0oA97nUwmU-2ENzc1EaNtXVuZ_6WcelgQ Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:29:46.872503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44cfaa7a9ec843e1a26460270f99a9e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44cfaa7a9ec843e1a26460270f99a9e2"}]}] Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 44cfaa7a9ec843e1a26460270f99a9e2 Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-TestVolumeBootPattern-58100835 Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: c0121ba668034aac98863a2caf80320e Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-TestVolumeBootPattern-58100835-project Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.880218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '609cf815-b2a9-4258-82a9-29d7eded8012'} Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:29:46.885029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. Sep 19 15:29:46.886633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:29:46.889382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Returning 404 to user: Instance 609cf815-b2a9-4258-82a9-29d7eded8012 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:29:46.889382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7076236f-826b-4231-baa9-9d762a75bc54 tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012" status: 404 len: 111 microversion: 2.1 time: 0.045227 Sep 19 15:29:46.889382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 466/1045] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:46 2022] GET /compute/v2.1/servers/609cf815-b2a9-4258-82a9-29d7eded8012 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:29:47.315476 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:47.318021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:47.324203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:47.324712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:47.325146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:47.325852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:47.326303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:47.326719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:47.361830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6ceb3876-3a6e-49a9-9df8-95f807b317a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050334 Sep 19 15:29:47.362729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 580/1046] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:47.643464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-ab807887-ed17-4df7-ba13-06e326e7f7ad req-7ec27611-2d1f-4824-a28e-7e32c571e438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31955ace-a21d-4a42-8e97-33da4bca71f0", "name": "network-vif-deleted", "tag": "a7905d0d-ddbc-4310-b98e-9d7db60cfd0d"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:47.646840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-ab807887-ed17-4df7-ba13-06e326e7f7ad req-7ec27611-2d1f-4824-a28e-7e32c571e438 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:47.648667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-ab807887-ed17-4df7-ba13-06e326e7f7ad req-7ec27611-2d1f-4824-a28e-7e32c571e438 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:47.649369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-ab807887-ed17-4df7-ba13-06e326e7f7ad req-7ec27611-2d1f-4824-a28e-7e32c571e438 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:47.667433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-ab807887-ed17-4df7-ba13-06e326e7f7ad req-7ec27611-2d1f-4824-a28e-7e32c571e438 service nova] Creating event network-vif-deleted:a7905d0d-ddbc-4310-b98e-9d7db60cfd0d for instance 31955ace-a21d-4a42-8e97-33da4bca71f0 on hv-cinder-75671 Sep 19 15:29:47.673542 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-ab807887-ed17-4df7-ba13-06e326e7f7ad req-7ec27611-2d1f-4824-a28e-7e32c571e438 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043641 Sep 19 15:29:47.674249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 467/1047] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:47.879507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:47.880231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:47.887450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:47.888039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:47.893971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:47.893971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:47.893971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:47.893971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:47.958662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:47.965929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-57a6e83c-fae0-4a5d-8e16-6679054e110e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091008 Sep 19 15:29:47.966495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 581/1048] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:48.375315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:48.377620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:48.384383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:48.384909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:48.385350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:48.386056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:48.386515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:48.386936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:48.416842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-803bc63e-9b0d-4bdc-b8a8-59b0512b0308 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Sep 19 15:29:48.417444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 468/1049] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:48.989151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:48.989885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:48.996937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:48.997426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:48.997866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:48.998575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:48.999030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:48.999461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:49.064923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:49.072997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-832cadd5-d761-4562-8afa-dd3e14c649cb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087975 Sep 19 15:29:49.073553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 582/1050] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:49.196350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1512217147", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f91a6788-cbf8-4d13-afa8-871086d6f4e4"}], "security_groups": [{"name": "tempest-securitygroup--1093054910"}], "key_name": "tempest-keypair-1837030334", "user_data": "}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:49.307901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] validate_networks() for [('f91a6788-cbf8-4d13-afa8-871086d6f4e4', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:29:49.399074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-775248062", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ff7392-2bca-4e1a-a6d9-bcf3e1581d76"}], "security_groups": [{"name": "tempest-securitygroup--1939990070"}], "key_name": "tempest-keypair-1814560511", "user_data": "}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:49.565144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] validate_networks() for [('67ff7392-2bca-4e1a-a6d9-bcf3e1581d76', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:29:49.863868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:29:49.864390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:29:49.864859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:29:49.865273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:29:49.865690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:29:49.874636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:49.875365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:49.875806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:49.876569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:49.877142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:49.877579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:49.894934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for project c727384d4ff043809f8421840cbd7596. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:29:49.898861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Getting quotas for user 833edf46ef9b4d3982ce49abc74933a2 and project c727384d4ff043809f8421840cbd7596. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:29:49.907991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:49.911165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:29:49.913619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:29:50.040877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-09a154bd-7fbf-4b76-bfbb-654e2697ca3b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.848771 Sep 19 15:29:50.041601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 469/1051] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:29:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:29:50.053129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:50.055411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:50.062957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:50.063480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:50.063926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:50.064682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:50.065262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:50.065643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:50.099274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d748dcfd-032d-4dbd-b2b6-eb678c8eb7e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050130 Sep 19 15:29:50.100154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 470/1052] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:50.104703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-82c97097-29f8-463a-b32e-ea1504ee849b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:50.105311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-82c97097-29f8-463a-b32e-ea1504ee849b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:50.129275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:29:50.130125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:29:50.131159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:29:50.131159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:29:50.131159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:29:50.142438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:50.142790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:50.143432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:50.144911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:50.145357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:50.145806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:50.162865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:29:50.165357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:50.168085 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Getting quotas for user 808156c7457b4e8b9b6c5f305755b3f3 and project e4de2627ff884f9f9afd68edb0dadf26. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:29:50.172335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-82c97097-29f8-463a-b32e-ea1504ee849b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:50.179814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:29:50.180100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-82c97097-29f8-463a-b32e-ea1504ee849b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1238 microversion: 2.1 time: 0.078816 Sep 19 15:29:50.180614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 471/1053] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:50 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:50.182769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:29:50.200788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:50.201730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:50.210522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:50.211487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:50.212261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:50.217358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:50.217358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:50.217358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:50.276889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:50.287928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33d580f1-ec30-44db-9cc3-a0b0f967c1ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.097997 Sep 19 15:29:50.288519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 472/1054] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:50.384982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-362e5dd7-e123-4b3a-896d-7492b96d8a1a tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.990215 Sep 19 15:29:50.385695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 583/1055] 10.222.0.75 () {62 vars in 1188 bytes} [Mon Sep 19 15:29:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 15:29:50.397615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3586a69d-1911-46a8-8d3a-2dd19c301ec1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:50.398193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3586a69d-1911-46a8-8d3a-2dd19c301ec1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:50.453489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3586a69d-1911-46a8-8d3a-2dd19c301ec1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:50.461529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3586a69d-1911-46a8-8d3a-2dd19c301ec1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:50.463025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3586a69d-1911-46a8-8d3a-2dd19c301ec1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:50.464133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3586a69d-1911-46a8-8d3a-2dd19c301ec1 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1281 microversion: 2.20 time: 0.071074 Sep 19 15:29:50.464899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 473/1056] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:50 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:51.111591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:51.114378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:51.121801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.122288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.122728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.123432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.123890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.124366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.156846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c6d2b3b3-3b71-4d1e-9886-a39077361578 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049279 Sep 19 15:29:51.157594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 584/1057] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:51.202739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:51.203378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:51.210562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.211057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.211497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.212198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.212700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.213134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.277037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:51.285120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-85ef06f3-2053-4174-ae7c-a385afe21216 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1242 microversion: 2.1 time: 0.086418 Sep 19 15:29:51.285686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 474/1058] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:51 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:51.312121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:51.313414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:51.320598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.321070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.321497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.322271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.322745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.323158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.387914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:51.395715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9b5a4754-5b57-4e41-a4b2-75c1be3cefd0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088546 Sep 19 15:29:51.396274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 585/1059] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:51.492883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:51.493629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:51.500533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.501027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.501468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.502176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:51.502690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:51.503121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:51.567568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:51.575986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:51.577472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:51.578575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0fcf7461-c057-4a80-9b52-73da869725bc tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1277 microversion: 2.20 time: 0.090947 Sep 19 15:29:51.579166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 475/1060] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:51 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:52.169443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:52.171681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:52.178241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.178717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.179171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.179849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.180294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.180748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.210423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-74277e7d-690b-4c33-a3c8-317e2ebea9f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Sep 19 15:29:52.210960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 586/1061] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:52.308961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:52.309485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:52.315990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.317818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.318265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.319023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.319481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.319912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.393669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:52.402841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-03b13999-9bcd-49e0-8c3b-2d604957a032 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1242 microversion: 2.1 time: 0.098033 Sep 19 15:29:52.403402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 476/1062] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:52 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:52.418153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:52.419043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:52.425007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.425504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.425929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.426637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.427112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.427731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.506795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:52.514906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5b6cc468-ab90-4363-a5d4-029d34312de1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.100421 Sep 19 15:29:52.515776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 587/1063] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:52.604014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:52.604675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:52.611505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.612159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.612630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.614535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:52.614998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:52.615475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:52.695681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:52.704050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:52.705564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:52.706671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33f302bd-ca4d-4513-a14e-f87f87847bf7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1351 microversion: 2.20 time: 0.107120 Sep 19 15:29:52.707400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 477/1064] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:52 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:53.223683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:53.226210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:53.232807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.233296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.233737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.234436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.234895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.235321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.267462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dc5e5e7f-7f9d-46b3-80fb-fc6bc362e04a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 Sep 19 15:29:53.268030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 588/1065] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:53.425847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:53.426552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:53.433432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.434028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.434494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.435212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.435665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.436081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.515663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:53.524334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1e0f09ec-d93f-4a9a-9fd3-45ea489e9592 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1298 microversion: 2.1 time: 0.102546 Sep 19 15:29:53.524973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 478/1066] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:53 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:53.539249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:53.540004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:53.547122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.547753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.548363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.549198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.549778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.550305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.650092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:53.658063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-044945cd-595b-42a5-b26c-f487f28ba0ba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.123372 Sep 19 15:29:53.658873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 589/1067] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:53.732145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:53.732860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:53.739005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.739563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.740264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:53.741064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:53.741624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:53.742174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.104157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:54.112800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:54.115094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:54.116898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-65add684-5b4d-49c1-bbbc-5695f2333e17 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.388678 Sep 19 15:29:54.117368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 479/1068] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:53 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:54.280886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:54.283217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:54.289865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:54.290339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:54.290764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.291448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:54.291892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:54.292304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.323706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-77ef5148-ca91-49e0-a4bf-f29def8458d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Sep 19 15:29:54.324270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 590/1069] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:29:54.547693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:54.548426 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:54.555412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:54.555901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:54.556557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.557266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:54.557729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:54.558159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.660946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:54.669050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d04cb371-4af3-4681-9d52-6362b772571b tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1296 microversion: 2.1 time: 0.125289 Sep 19 15:29:54.669626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 480/1070] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:54 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1296 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:54.682114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:54.683064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:54.689344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:54.689711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:54.690181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.690930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:54.691370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:54.691838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:54.696158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:54.995941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:55.003672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9c518228-de2a-4e27-a77c-5f180eac0b14 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.325602 Sep 19 15:29:55.004330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 591/1071] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:55.142356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:55.142998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:55.150209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.150706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.151730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:55.152446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.152925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.153351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:55.193362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-e2aba62d-72b4-437d-81d6-39dcc3c16413 req-b6cb835b-7703-4e4e-b951-d5e8a78968dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99bd356-ddca-4b48-99db-8ea35f0bc190", "tag": "1c21fec3-1ba6-4250-9249-a9d49c1148ad"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:55.215947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-e2aba62d-72b4-437d-81d6-39dcc3c16413 req-b6cb835b-7703-4e4e-b951-d5e8a78968dd service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.216419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-e2aba62d-72b4-437d-81d6-39dcc3c16413 req-b6cb835b-7703-4e4e-b951-d5e8a78968dd service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.218907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-e2aba62d-72b4-437d-81d6-39dcc3c16413 req-b6cb835b-7703-4e4e-b951-d5e8a78968dd service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:55.232329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-e2aba62d-72b4-437d-81d6-39dcc3c16413 req-b6cb835b-7703-4e4e-b951-d5e8a78968dd service nova] Creating event network-changed:1c21fec3-1ba6-4250-9249-a9d49c1148ad for instance a99bd356-ddca-4b48-99db-8ea35f0bc190 on hv-cinder-75671 Sep 19 15:29:55.239198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-e2aba62d-72b4-437d-81d6-39dcc3c16413 req-b6cb835b-7703-4e4e-b951-d5e8a78968dd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059298 Sep 19 15:29:55.240600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 592/1072] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:55.338513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:55.340933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:55.350106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.350605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.351264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:55.351984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.352444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.353049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:55.390930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9d97be64-7c1e-48ca-8ed0-35b5d0911766 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058900 Sep 19 15:29:55.391952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 593/1073] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:29:55.489233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:55.498266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:55.499966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:55.501265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4703d155-815b-4f89-9728-9a1042fc8a25 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.362924 Sep 19 15:29:55.502383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 481/1074] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:55 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:55.692406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:55.693132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:55.699406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.699884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.700309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:55.701043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:55.701489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:55.701910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.027385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:56.028005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:56.035035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:56.035907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:56.036361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.037142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:56.037607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:56.038096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.057262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:56.065211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cfd8d366-8ac5-4356-8e38-49d2fee3c2a7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.376578 Sep 19 15:29:56.065904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 594/1075] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:55 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:56.140792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:56.149732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f19ecccb-abec-48fa-80f9-891ed05a7efd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.126930 Sep 19 15:29:56.150312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 482/1076] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:29:56.403462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:56.405758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:56.413309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:56.413750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:56.414180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.414885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:56.415328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:56.415934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.452306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1ce81684-347a-42b4-bb0a-71354b035107 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052802 Sep 19 15:29:56.453207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 595/1077] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:56.528750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:56.529732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:56.535790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:56.536350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:56.536930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.537744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:56.538278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:56.538765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:56.732028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:56.735819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:29:56.741674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:56.743397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:56.744549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d1d16e08-6360-4966-aa45-02e7b12af097 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.221163 Sep 19 15:29:56.745119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 483/1078] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:56 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:57.088745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:57.089391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:57.095387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.095883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.096304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.097027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.098159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.099196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.173339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:57.174080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:57.180898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.181380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.181811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.182503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.182954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.183373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.258415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:57.262682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:57.266462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-624a9e34-857c-4e46-a95a-04d4e5bb0d51 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.096988 Sep 19 15:29:57.267036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 484/1079] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:29:57.271067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4354dd1f-12c7-48fc-95a0-71bd480ead74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.186256 Sep 19 15:29:57.271791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 596/1080] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:57 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:57.272221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-2c0beb05-e5fb-4c11-9c7b-94947f3b8c6b req-c83f704d-6669-4795-a60f-db0593e11cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b26b35-8784-4bb4-8d1b-b962f6104f7f", "tag": "f96317d7-11bd-464a-9e57-bab13bb12c3f"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:29:57.281468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-2c0beb05-e5fb-4c11-9c7b-94947f3b8c6b req-c83f704d-6669-4795-a60f-db0593e11cb8 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.281948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-2c0beb05-e5fb-4c11-9c7b-94947f3b8c6b req-c83f704d-6669-4795-a60f-db0593e11cb8 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.282381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-2c0beb05-e5fb-4c11-9c7b-94947f3b8c6b req-c83f704d-6669-4795-a60f-db0593e11cb8 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.293856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-2c0beb05-e5fb-4c11-9c7b-94947f3b8c6b req-c83f704d-6669-4795-a60f-db0593e11cb8 service nova] Creating event network-changed:f96317d7-11bd-464a-9e57-bab13bb12c3f for instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f on hv-cinder-75671 Sep 19 15:29:57.298679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-2c0beb05-e5fb-4c11-9c7b-94947f3b8c6b req-c83f704d-6669-4795-a60f-db0593e11cb8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030555 Sep 19 15:29:57.299243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 485/1081] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:57.464990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:57.467044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:57.473454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.473920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.474347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.475026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.475495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.475907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.505137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8c99b28b-146b-4abf-80c0-0f3ffc19d132 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Sep 19 15:29:57.505677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 597/1082] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:57.771126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:57.771761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:57.778207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.778676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.779118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.779825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:57.780287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:57.780741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:57.916153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:57.924445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:57.926080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:57.927194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b1e374e3-e3e1-453a-ba14-01b40fd246f3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.161274 Sep 19 15:29:57.927744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 486/1083] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:57 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:58.291134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:58.291756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:58.294118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:58.294858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:58.297769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.298255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.298693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.299396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.299851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.300274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.300957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.301433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.301863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.302548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.303000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.303423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.368713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:58.376317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0c57ae32-c486-4d85-b2d2-df1fac550c3a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089123 Sep 19 15:29:58.376896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 598/1084] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:58.450642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:58.458866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-520a05e8-3361-4160-b787-ddf7afad1da6 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.168503 Sep 19 15:29:58.459421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 487/1085] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:58 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:29:58.517463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:58.520385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:58.526765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.527248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.527685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.528374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.528857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.529281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.558183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cac2cca3-b046-404d-ac7e-8d82253b6c58 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Sep 19 15:29:58.558659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 599/1086] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:29:58.951693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:58.952299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:58.958519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.958997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.959430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:58.960111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:58.960593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:58.961014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.197814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:59.205968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:59.210350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:59.210350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c983f0ed-f839-4a25-a32e-f1283fa935ef tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.261736 Sep 19 15:29:59.211133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 488/1087] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:29:58 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:29:59.399884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:59.400461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:59.406831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:59.407308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:59.407743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.408431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:59.408982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:59.409430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.481891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:59.482518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:59.493185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:59.493185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:59.493185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.493558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:59.493680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:59.493680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:59.493680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.500665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b8826eef-f4bb-4226-a786-80e9aa1f14d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.104669 Sep 19 15:29:59.501376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 600/1088] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:29:59.570655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:29:59.573520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:29:59.580315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:59.583393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:59.583393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.583393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:29:59.583857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:29:59.584280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:29:59.615629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-34c07ad2-8e21-4fcd-853b-a77f316aa6ba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Sep 19 15:29:59.616515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 601/1089] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:29:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:29:59.732374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:29:59.743107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1d33a992-a01b-42f2-9fd3-8f17a0c6b9cb tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.265417 Sep 19 15:29:59.743912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 489/1090] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:29:59 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:00.237186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:00.237799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:00.240504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:00.241166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=10 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:00.246252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.246735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.247176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.247870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.248323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.248786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.379320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:00.387387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:00.394587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:00.394587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bf8264c1-089b-4a50-bb7e-76dee79956b6 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.157029 Sep 19 15:30:00.394587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 602/1091] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:30:00 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:30:00.523843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:00.524638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:00.526610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=4 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:00.527369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=20 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:00.533108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.533596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.540381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.540381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.540381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.540381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.600684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:00.608566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bbee82d2-e41e-4b9a-bbd5-9ec2996b534a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088618 Sep 19 15:30:00.609130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 490/1092] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:00.628610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:00.630984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:00.637411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.637890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.638321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.639011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.639464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.639888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.669135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-711c0645-e2ef-43f6-80f0-a996d0d59e78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Sep 19 15:30:00.669690 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 603/1093] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:00.767380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:00.767992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:00.775177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.775801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.776795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.777552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:00.778223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:00.778662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:00.916468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:00.924223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dfec7337-35df-472d-bc37-f263b1921030 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.161421 Sep 19 15:30:00.924816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 491/1094] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:00 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:01.416137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:01.416693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:01.422592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.423064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.423492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.424174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.424777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.425236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.554851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:01.563385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:01.564873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:01.566029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e08b6a48-52ee-44f8-9331-9475165285e5 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.153969 Sep 19 15:30:01.566673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 604/1095] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:30:01 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:30:01.633138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:01.633740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:01.639628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.640112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.640582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.641285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.641746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.642175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.681428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:01.683603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:01.690077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.690657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.691164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.692034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.692589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.693080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.706267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:01.714796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe9d0f87-a9f8-484f-84c1-ef9f460a65f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086133 Sep 19 15:30:01.715369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 492/1096] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:01.725759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-573d154a-92a0-4681-b276-8324afccf901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048401 Sep 19 15:30:01.726314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 605/1097] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:01.947886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:01.948427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:01.954420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.954909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.955349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:01.956052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:01.956539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:01.957101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:02.051726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-56b6c62b-acd8-45cb-b13a-2d59a10374f3 req-d68ad26a-1822-4979-a2bc-c85b823088fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99bd356-ddca-4b48-99db-8ea35f0bc190", "name": "network-vif-plugged", "status": "completed", "tag": "1c21fec3-1ba6-4250-9249-a9d49c1148ad"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:02.054181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-56b6c62b-acd8-45cb-b13a-2d59a10374f3 req-d68ad26a-1822-4979-a2bc-c85b823088fe service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:02.054660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-56b6c62b-acd8-45cb-b13a-2d59a10374f3 req-d68ad26a-1822-4979-a2bc-c85b823088fe service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:02.055094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-56b6c62b-acd8-45cb-b13a-2d59a10374f3 req-d68ad26a-1822-4979-a2bc-c85b823088fe service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:02.067016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-56b6c62b-acd8-45cb-b13a-2d59a10374f3 req-d68ad26a-1822-4979-a2bc-c85b823088fe service nova] Creating event network-vif-plugged:1c21fec3-1ba6-4250-9249-a9d49c1148ad for instance a99bd356-ddca-4b48-99db-8ea35f0bc190 on hv-cinder-75671 Sep 19 15:30:02.072553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-56b6c62b-acd8-45cb-b13a-2d59a10374f3 req-d68ad26a-1822-4979-a2bc-c85b823088fe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088807 Sep 19 15:30:02.073680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 606/1098] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:02.095843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:02.104291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6eecee60-2ccc-4157-b9ab-e00350b13376 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.160412 Sep 19 15:30:02.104896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 493/1099] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:01 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:02.593009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:02.593734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:02.600637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:02.601111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:02.601534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:02.602221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:02.602663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:02.603080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:02.738810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:02.739375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:02.746346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:02.746839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:02.747278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:02.748000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:02.748462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:02.748924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:02.982224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:02.990981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6db02fb7-7f47-4ed8-a290-5c101ceb2d2f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.256535 Sep 19 15:30:02.991481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 494/1100] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:02.996350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:02.998657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:03.005049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:03.005535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:03.006155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:03.006871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:03.007331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:03.007756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:03.045663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dd1c3fae-a947-47a4-a452-f28c5d0f5153 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053130 Sep 19 15:30:03.046223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 495/1101] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:03.130030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:03.130645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:03.136498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:03.136982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:03.137418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:03.138112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:03.138558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:03.139020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:03.144667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:03.152821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:03.154293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:03.155825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c3ee734-fa0b-41e5-b65f-54d9776a85ea tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.567295 Sep 19 15:30:03.156384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 607/1102] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:30:02 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 15:30:03.274912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:03.282642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-810a421a-30f7-4429-bf46-39513dbf7057 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.158947 Sep 19 15:30:03.283200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 496/1103] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:03 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:04.014873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:04.015489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:04.021971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.022442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.022901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.023577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.024018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.024433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.058826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:04.062520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:04.070603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.071225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.071898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.072665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.073124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.073547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.105996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-72df08c3-f76a-427f-ab42-4694e400735b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051090 Sep 19 15:30:04.106859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 497/1104] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:04.127131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:04.135841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c68be3e8-7187-477a-8181-69259f0d5302 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.124750 Sep 19 15:30:04.136412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 608/1105] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:04.182495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:04.183091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:04.189758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.190243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.190696 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.192235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.192809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.193237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.306147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:04.306759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:04.313821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.314695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.315130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.316098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:04.316622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:04.317045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:04.321294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:04.337662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:04.345796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:04.347940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:04.349209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e35ca9bc-895e-48a9-b9ae-ea7891cfc20f tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1407 microversion: 2.20 time: 0.170777 Sep 19 15:30:04.349768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 498/1106] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:30:04 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:30:04.446765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:04.454275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1d703777-b5be-4163-998c-9f19566af6c8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.152020 Sep 19 15:30:04.454836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 609/1107] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:04 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:05.119132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:05.121321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:05.127689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.128168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.129171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.129859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.130311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.130732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.158451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:05.159062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:05.162878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0766bf96-0b82-4938-b5ba-9a1e215f5dab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047960 Sep 19 15:30:05.163436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 499/1108] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:05.173713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.174208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.174640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.175342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.175788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.176295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.238147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:05.246276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-035b2e37-59ca-4de9-9d3d-789f6298af21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091699 Sep 19 15:30:05.246836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 610/1109] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:05.374052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:05.374593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:05.381256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.384602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.384602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.384602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.384602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.384984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.476967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:05.477590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:05.483451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.483936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.484374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.485109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.485563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.485990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.518017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:05.526287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:05.527761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:05.528981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe4ca6c0-aeac-45a2-a24f-6a8b20ce039c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1597 microversion: 2.20 time: 0.158974 Sep 19 15:30:05.529624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 500/1110] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:30:05 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:30:05.554143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:05.554650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:05.560909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.561415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.561845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.562534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:05.562986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:05.563405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:05.567862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:05.655579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:05.664269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9f922b67-7b51-450e-b639-7922fbf03f45 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.191110 Sep 19 15:30:05.665027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 611/1111] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:05 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:05.668372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-18895695-b777-4499-8232-fe4f930da739 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118994 Sep 19 15:30:05.668985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 501/1112] 10.222.0.75 () {60 vars in 1316 bytes} [Mon Sep 19 15:30:05 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 15:30:06.030738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-ae19d031-a7b4-4198-a682-804030a08dd9 req-0d7ac362-89f2-4ee4-b772-bf379ee0ece5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b26b35-8784-4bb4-8d1b-b962f6104f7f", "name": "network-vif-plugged", "status": "completed", "tag": "f96317d7-11bd-464a-9e57-bab13bb12c3f"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:06.041254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ae19d031-a7b4-4198-a682-804030a08dd9 req-0d7ac362-89f2-4ee4-b772-bf379ee0ece5 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.041738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ae19d031-a7b4-4198-a682-804030a08dd9 req-0d7ac362-89f2-4ee4-b772-bf379ee0ece5 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.042157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ae19d031-a7b4-4198-a682-804030a08dd9 req-0d7ac362-89f2-4ee4-b772-bf379ee0ece5 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.058058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-ae19d031-a7b4-4198-a682-804030a08dd9 req-0d7ac362-89f2-4ee4-b772-bf379ee0ece5 service nova] Creating event network-vif-plugged:f96317d7-11bd-464a-9e57-bab13bb12c3f for instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f on hv-cinder-75671 Sep 19 15:30:06.063738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-ae19d031-a7b4-4198-a682-804030a08dd9 req-0d7ac362-89f2-4ee4-b772-bf379ee0ece5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037170 Sep 19 15:30:06.065138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 612/1113] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:06.175712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:06.178456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:06.186185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.186687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.188348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.188348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.189047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.190103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.231597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-06737bbf-02c3-4ca2-9bf9-eaf9262f9eb4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060920 Sep 19 15:30:06.232285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 502/1114] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:06.272738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:06.273483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:06.279785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.280354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.280826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.281526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.281976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.282568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.385964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:06.393597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a809d4f0-9ae7-409e-978b-15c158b02a1f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.127525 Sep 19 15:30:06.394726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 613/1115] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:06.687192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:06.687798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:06.694178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.694654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.695082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.695771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.696217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:06.696667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:06.923357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:06.931969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-64cc0386-a222-4d3c-80a3-4778ed35d9b7 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.248568 Sep 19 15:30:06.932578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 503/1116] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:06 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:06.988942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-b99b81a5-979e-4d04-93f5-ca21d214d02c req-61b4299d-d346-4663-b2ad-a536f1d07ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99bd356-ddca-4b48-99db-8ea35f0bc190", "tag": "1c21fec3-1ba6-4250-9249-a9d49c1148ad"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:06.999411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b99b81a5-979e-4d04-93f5-ca21d214d02c req-61b4299d-d346-4663-b2ad-a536f1d07ece service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:06.999883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b99b81a5-979e-4d04-93f5-ca21d214d02c req-61b4299d-d346-4663-b2ad-a536f1d07ece service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.000310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b99b81a5-979e-4d04-93f5-ca21d214d02c req-61b4299d-d346-4663-b2ad-a536f1d07ece service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:07.012532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-b99b81a5-979e-4d04-93f5-ca21d214d02c req-61b4299d-d346-4663-b2ad-a536f1d07ece service nova] Creating event network-changed:1c21fec3-1ba6-4250-9249-a9d49c1148ad for instance a99bd356-ddca-4b48-99db-8ea35f0bc190 on hv-cinder-75671 Sep 19 15:30:07.017830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-b99b81a5-979e-4d04-93f5-ca21d214d02c req-61b4299d-d346-4663-b2ad-a536f1d07ece service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033271 Sep 19 15:30:07.018441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 614/1117] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:07.244676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:07.246952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:07.253913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:07.254399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.254874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:07.255578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:07.256028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.256468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:07.289762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2553657e-d1c5-45e1-9da6-8b2373392f79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049366 Sep 19 15:30:07.290338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 504/1118] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:07.418667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:07.419379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:07.426177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:07.426659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.427097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:07.427797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:07.428251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.428703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:07.540809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:07.548522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-59470e3a-8013-4562-8a93-e4a272672129 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.134164 Sep 19 15:30:07.549247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 615/1119] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:07.955977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:07.957246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:07.964020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:07.964834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.965278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:07.965995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:07.966464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:07.966888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:08.187671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:08.197027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5bc8f530-30c3-493a-8063-8ab1a0349cd4 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1364 microversion: 2.1 time: 0.244884 Sep 19 15:30:08.197824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 505/1120] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:07 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:08.304121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:08.306389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:08.313176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:08.313657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:08.314093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:08.314796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:08.315249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:08.315673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:08.347023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-36e33bff-7dbd-4c96-b0b7-bd0ad7fbdf35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048509 Sep 19 15:30:08.348193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 616/1121] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:08.572832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:08.573453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:08.579899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:08.580388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:08.580864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:08.582250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:08.582901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:08.583342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:08.646338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:08.654126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-64371d99-94bc-4506-be78-c05ba2603384 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085340 Sep 19 15:30:08.654729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 506/1122] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:09.220504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:09.221114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:09.227428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.227917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.228358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.229128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.229643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.230074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.359486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:09.361826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:09.362083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:09.368787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.369276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.369717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.370425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.370755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-52442ac7-6db4-4124-b080-afa078c3eed8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1550 microversion: 2.1 time: 0.154153 Sep 19 15:30:09.370864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.371323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 617/1123] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:09 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:09.371473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.394954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:09.395440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:09.400898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-785ab6cd-27e0-47eb-849c-0a29bc11e6f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045376 Sep 19 15:30:09.401198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.401461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 507/1124] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:09.405839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.405839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.405839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.405839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.406209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.480260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fe277cb0-35e9-4404-8f31-a0df0bd7f126 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089237 Sep 19 15:30:09.480890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 618/1125] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:30:09 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:09.678340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:09.678942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:09.685260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.685741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.686169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:09.686858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:09.687310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:09.687736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:10.006184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:10.014038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9bc6efe9-549c-49a6-b556-a9d31f93eab9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.340681 Sep 19 15:30:10.014604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 508/1126] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:10.414576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:10.416878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:10.422823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:10.423304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:10.423741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:10.424434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:10.424906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:10.425508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:10.455251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-28eb9dad-2c57-4d9e-a40f-46c947f4860e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Sep 19 15:30:10.456013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 619/1127] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:10.727727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-a62816a7-09f1-4335-9555-d61620b43313 req-5b218b88-5ebf-4fe9-ad54-60c6e0411071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b26b35-8784-4bb4-8d1b-b962f6104f7f", "tag": "f96317d7-11bd-464a-9e57-bab13bb12c3f"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:30:10.738375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a62816a7-09f1-4335-9555-d61620b43313 req-5b218b88-5ebf-4fe9-ad54-60c6e0411071 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:10.738806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a62816a7-09f1-4335-9555-d61620b43313 req-5b218b88-5ebf-4fe9-ad54-60c6e0411071 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:10.739241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-a62816a7-09f1-4335-9555-d61620b43313 req-5b218b88-5ebf-4fe9-ad54-60c6e0411071 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:10.757713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-a62816a7-09f1-4335-9555-d61620b43313 req-5b218b88-5ebf-4fe9-ad54-60c6e0411071 service nova] Creating event network-changed:f96317d7-11bd-464a-9e57-bab13bb12c3f for instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f on hv-cinder-75671 Sep 19 15:30:10.762982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-a62816a7-09f1-4335-9555-d61620b43313 req-5b218b88-5ebf-4fe9-ad54-60c6e0411071 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038942 Sep 19 15:30:10.763795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 509/1128] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:11.038429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:11.039355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:11.045326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:11.045932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:11.046462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:11.047412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:11.047944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:11.048464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:11.124948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:11.133375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-31cbd8f5-5107-48bd-b145-5afbd3282471 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.099417 Sep 19 15:30:11.134219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 620/1129] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:11.469618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:11.473125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:11.479794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:11.480503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:11.480893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:11.481609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:11.482073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:11.482501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:11.513884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-92fa5ec0-565c-4d7b-a4e9-54b180a5dfd9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Sep 19 15:30:11.514463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 510/1130] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:12.155805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:12.156423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:12.163190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:12.163676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:12.164116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:12.164854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:12.165309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:12.165734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:12.228643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:12.236337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-af248698-4660-4f17-8315-2dfc0c901a66 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084473 Sep 19 15:30:12.236926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 621/1131] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:12.526525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:12.528691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:12.535644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:12.536122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:12.536582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:12.537271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:12.537724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:12.538147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:12.567568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9967f5b6-5081-4d75-bf3b-3441769ded62 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Sep 19 15:30:12.568111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 511/1132] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:13.259271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:13.259878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:13.266280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:13.266750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:13.267173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:13.267850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:13.268294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:13.268773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:13.333889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:13.341625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-34c6f0b0-5faf-4d2d-9c51-55230220bae5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086310 Sep 19 15:30:13.342189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 622/1133] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:13.579479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:13.582306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:13.588933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:13.589429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:13.589868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:13.590582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:13.591042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:13.591473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:13.623567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-63ac0ec5-a418-4c46-ab91-402296166c2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048038 Sep 19 15:30:13.624126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 512/1134] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:14.365540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:14.366151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:14.372889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:14.373361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:14.373790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:14.374472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:14.374922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:14.375337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:14.438323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:14.446727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c284815c-b320-4b1a-8de4-f3479f3887e6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085894 Sep 19 15:30:14.447284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 623/1135] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:14.635429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:14.637684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:14.644787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:14.645275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:14.645715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:14.646415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:14.648918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:14.649380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:14.680591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c0a63c73-877f-48d4-a38d-cc7b9b20297b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049078 Sep 19 15:30:14.681163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 513/1136] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:15.470169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:15.470787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:15.477965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:15.478433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:15.478865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:15.479559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:15.480014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:15.480439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:15.544170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:15.552527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-66d8b71d-0e31-41b2-8f59-6139c8a56547 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086334 Sep 19 15:30:15.553087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 624/1137] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:15.693404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:15.695574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:15.703675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:15.704166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:15.704655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:15.705367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:15.705820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:15.708143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:15.740465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-421b9de1-1e39-41ff-9a25-13099dfa8848 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051206 Sep 19 15:30:15.740995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 514/1138] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:16.575227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:16.575841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:16.582990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:16.583471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:16.583934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:16.584694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:16.585141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:16.585558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:16.648679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:16.656835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8a5a7466-25ec-4504-a3ec-52c79d3d3679 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085422 Sep 19 15:30:16.657406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 625/1139] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:16.754330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:16.756414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:16.759938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:16.763295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:16.763772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:16.764205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:16.764936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:16.765391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:16.765816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:16.797779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5376f9c8-a2d9-46cc-aa48-fc9599e944e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048397 Sep 19 15:30:16.802907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 515/1140] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:17.679911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:17.680552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:17.687049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:17.687530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:17.687967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:17.688701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:17.689159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:17.689582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:17.754776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:17.762780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a81304e-6d2f-4da6-aad8-51b788e38f0f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086762 Sep 19 15:30:17.763353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 626/1141] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:17.811002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:17.815179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:17.823258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:17.823740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:17.824229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:17.824949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:17.825457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:17.825899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:17.856769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4eec2827-fe5d-4716-b659-c7a7d2d5b760 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049757 Sep 19 15:30:17.857318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 516/1142] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:18.786866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:18.787476 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:18.793900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:18.794381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:18.794833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:18.795501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:18.795955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:18.796374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:18.815296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:18.864868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:18.869605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:18.872500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:18.873470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-63bacf63-8e2d-40dc-a221-d8d95027648d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091182 Sep 19 15:30:18.879043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:18.879872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:18.880473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:18.881367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:18.881987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:18.883062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:18.888687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 627/1143] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:18.913709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-af066298-84d4-4afb-bc05-7e1fd351a2c9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Sep 19 15:30:18.914254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 517/1144] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:19.897396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:19.897971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:19.905319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:19.905940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:19.906380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:19.907078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:19.907529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:19.907952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:19.926818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:19.929267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:19.935329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:19.935813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:19.936250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:19.936969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:19.937418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:19.937830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:19.964332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:19.969437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c5a3dc01-5b34-4be7-b94f-e751f5875f68 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Sep 19 15:30:19.976881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:19.977627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 518/1145] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:19.977743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-46419c39-821d-4877-864a-2cc7b69f7204 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084839 Sep 19 15:30:19.978225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 628/1146] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:20.982495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:20.984758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:20.991852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:20.992329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:20.993054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:20.993745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:20.994195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:20.994629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:21.000315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:21.000970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:21.005259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:21.008757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:21.009807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:21.009807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:21.010365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:21.010819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:21.011242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:21.026869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f0cfb247-bc31-4a7b-a0d4-e5739eb4b74b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048418 Sep 19 15:30:21.027438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 519/1147] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:21.073769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:21.082315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-241cb3d9-9d13-4892-9c6c-5f9c7bf73768 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085844 Sep 19 15:30:21.082877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 629/1148] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:22.040308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:22.042443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:22.049018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:22.049494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:22.049926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:22.050615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:22.051067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:22.051490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:22.080225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2b81a838-4911-4c95-8960-726bb816d607 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Sep 19 15:30:22.080798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 520/1149] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:22.104791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:22.105394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:22.111663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:22.112136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:22.112591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:22.113273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:22.113713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:22.114128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:22.177772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:22.185405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f48784e9-4fa7-45b7-b103-b3271381893a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084501 Sep 19 15:30:22.185970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 630/1150] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:23.093471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:23.095627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:23.102233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:23.102721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:23.103167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:23.103859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:23.104316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:23.104794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:23.134463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-98371664-fcaf-4c0e-8b6b-af2aef09958b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Sep 19 15:30:23.134992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 521/1151] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:23.209297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:23.209920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:23.216282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:23.216796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:23.217235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:23.217926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:23.218382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:23.218806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:23.279666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:23.288443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62df88fb-b1e2-4650-92c3-1c1d84ad9a17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083926 Sep 19 15:30:23.289026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 631/1152] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:24.146587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:24.149344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:24.155641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:24.156121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:24.156575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:24.157257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:24.157707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:24.158125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:24.186893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-731f0ac3-19cb-49e8-8420-6171fa38fdd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Sep 19 15:30:24.187437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 522/1153] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:24.311186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:24.311806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:24.318167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:24.318646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:24.319087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:24.320034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:24.320507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:24.320939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:24.384489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:24.392320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9eb1e86c-b70a-4169-a42f-87e6aa1e55e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085044 Sep 19 15:30:24.392919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 632/1154] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:25.199357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:25.201562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:25.207919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:25.208393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:25.208877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:25.209586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:25.210041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:25.210461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:25.239516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e7691db5-4637-4441-89d2-764b3f2c0eb1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Sep 19 15:30:25.240052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 523/1155] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:25.416096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:25.424679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:25.424679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:25.424679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:25.424679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:25.425149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:25.425242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:25.425605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:25.492193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:25.500258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f601d6cf-fbc9-4727-bb71-ee3eceedc6b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088910 Sep 19 15:30:25.500838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 633/1156] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:26.252933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:26.255114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:26.262208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:26.262722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:26.263157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:26.263850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:26.264303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:26.264764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:26.293703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e75bc364-3951-4c8e-a359-d7622b916903 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Sep 19 15:30:26.294258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 524/1157] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:26.522752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:26.523304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:26.529634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:26.530105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:26.530530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:26.531212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:26.531656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:26.532071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:26.597737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:26.605762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-805511d8-f4d8-453a-9101-b823085d2548 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087068 Sep 19 15:30:26.606315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 634/1158] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:27.306278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:27.308470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:27.314856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:27.315341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:27.315778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:27.316492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:27.316955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:27.317383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:27.347664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b726d3ff-ce54-4611-abc4-fb44a3b2b53d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Sep 19 15:30:27.348722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 525/1159] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:27.629068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:27.629830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:27.636891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:27.637366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:27.637790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:27.638471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:27.638926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:27.639338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:27.701517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:27.709275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b055aa93-d346-41fa-8fbb-4e4b5e7d6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084151 Sep 19 15:30:27.709839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 635/1160] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:28.363508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:28.365721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:28.372694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:28.373172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:28.373617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:28.374311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:28.374773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:28.375198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:28.405698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f46c4215-aec7-40da-99f3-d58e036d7e0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Sep 19 15:30:28.406264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 526/1161] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:28.734143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:28.734773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:28.741248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:28.741726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:28.742164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:28.743118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:28.743569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:28.743994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:28.805902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:28.813826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dfd83163-314f-4d96-9328-3899d0c39b39 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084924 Sep 19 15:30:28.814387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 636/1162] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:29.418263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:29.420765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:29.427230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:29.427710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:29.428146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:29.428871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:29.429329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:29.429753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:29.460334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-04e7c296-2320-471f-814f-e3144ce82415 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Sep 19 15:30:29.461290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 527/1163] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:29.837190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:29.837811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:29.844808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:29.845291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:29.845730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:29.846426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:29.846883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:29.847309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:29.908506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:29.916203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-13fa3bcc-679a-4c5f-a827-038e97fc9a69 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082981 Sep 19 15:30:29.916787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 637/1164] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:30.472843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:30.475008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:30.481625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:30.482097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:30.482530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:30.483216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:30.483667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:30.484092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:30.513128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe9a5bd1-1ca3-44f4-8e83-67b100c863a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Sep 19 15:30:30.513768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 528/1165] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:30.940368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:30.941018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:30.947397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:30.947874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:30.948307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:30.949026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:30.949479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:30.950469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:31.015313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:31.022990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c4dc4464-c820-4529-aa4e-d096cf680d21 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086477 Sep 19 15:30:31.023537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 638/1166] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:31.526066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:31.529006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:31.537866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:31.538354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:31.538795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:31.539502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:31.539956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:31.540384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:31.573029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ca42d31e-7c55-4f7d-880e-48c859fc6e46 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050936 Sep 19 15:30:31.573595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 529/1167] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:32.048938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:32.049478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:32.055731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:32.056207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:32.056675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:32.057355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:32.057798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:32.058212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:32.118664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:32.126979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-96611b1b-8892-45a6-947f-7d548837be13 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081982 Sep 19 15:30:32.127532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 639/1168] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:32.593326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:32.593326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:32.594632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:32.595112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:32.595550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:32.596242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:32.596722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:32.597147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:32.627742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-67d3c0ff-e7bd-4ee2-9483-c76bcdcba4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Sep 19 15:30:32.628298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 530/1169] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:33.150546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:33.151151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:33.158194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:33.158676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:33.159111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:33.159801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:33.160252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:33.160705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:33.223211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:33.231674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dbea2b67-c316-462b-9b8c-a5edc50c9975 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084310 Sep 19 15:30:33.232245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 640/1170] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:33.640459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:33.642674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:33.649235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:33.649721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:33.650163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:33.650862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:33.651316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:33.651743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:33.680455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5246c3b7-f1b9-43be-844c-3e58732a3508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Sep 19 15:30:33.681027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 531/1171] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:34.255252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:34.255862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:34.262268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:34.262791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:34.263217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:34.263895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:34.264337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:34.264851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:34.324605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:34.332161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5b22f884-1e12-47b5-b66b-bda97548d3a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.080903 Sep 19 15:30:34.332737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 641/1172] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:34.693646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:34.695857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:34.703465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:34.703951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:34.704384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:34.705107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:34.705560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:34.705985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:34.735945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e38e1a5a-7630-4443-bf43-6ecad77a0c26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046366 Sep 19 15:30:34.736513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 532/1173] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:35.355279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:35.356019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:35.362744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:35.363228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:35.363662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:35.364364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:35.365311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:35.365735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:35.433775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:35.442349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bf344f41-1cc6-48c0-bfa0-e3e33ef29742 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090942 Sep 19 15:30:35.442911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 642/1174] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:35.748168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:35.750437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:35.757207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:35.757693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:35.758128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:35.758839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:35.759293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:35.759724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:35.791236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-531d86c5-1805-4151-ad66-2e289a1d73bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Sep 19 15:30:35.791800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 533/1175] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:36.466600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:36.467327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:36.473578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:36.474168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:36.474667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:36.475465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:36.476993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:36.477431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:36.541534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:36.549634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b1b0fcf1-c8ef-4c33-8caf-3e2b9a9ada16 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087756 Sep 19 15:30:36.550285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 643/1176] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:36.803485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:36.805737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:36.812970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:36.813473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:36.813914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:36.814706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:36.815168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:36.815600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:36.846193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2dce15c-dd67-4ca5-b297-d394fbadce21 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Sep 19 15:30:36.846757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 534/1177] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:37.572855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:37.573834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:37.581795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:37.582280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:37.582714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:37.583419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:37.583874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:37.584306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:37.590474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:37.651137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:37.659144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bbfc0f48-fc79-4e99-ae91-f7b7c3b31e8d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090281 Sep 19 15:30:37.659710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 644/1178] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:37.859640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:37.861816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:37.868900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:37.869607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:37.870047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:37.870759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:37.871216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:37.872436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:37.890153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:37.903840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8d56dbf9-85e4-4d38-8b9d-5af83945b052 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048997 Sep 19 15:30:37.906477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 535/1179] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:38.682486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:38.683113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:38.690161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:38.690660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:38.691174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:38.692035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:38.692591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:38.693019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:38.759466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:38.769476 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1d01ba52-5042-4786-8983-12360454163d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090922 Sep 19 15:30:38.770054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 645/1180] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:38.916500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:38.918762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:38.926054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:38.926600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:38.926985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:38.927690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:38.928216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:38.928719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:38.959783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1cf8150f-fa92-4a44-b30a-47d5f2edd0d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Sep 19 15:30:38.960275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 536/1181] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:39.795048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:39.795667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:39.801895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:39.802368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:39.802798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:39.803503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:39.803944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:39.804360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:39.872105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:39.880277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c7871871-3535-4e8a-ba5b-e5fc40121b25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090709 Sep 19 15:30:39.880862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 646/1182] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:39.971605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:39.973833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:39.981646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:39.982334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:39.982789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:39.983507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:39.983964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:39.984395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:40.016731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9eae291c-fb0d-4e43-9721-4ba0d4879fbf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049105 Sep 19 15:30:40.017302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 537/1183] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:40.903446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:40.904198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:40.911234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:40.911716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:40.912151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:40.913123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:40.913579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:40.913998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:40.982628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:40.990284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e12ea756-4af6-41f8-b40e-69fe1f49c4b0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090993 Sep 19 15:30:40.990844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 647/1184] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:30:41.157820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:41.160058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:41.166473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:41.166965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:41.171135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:41.171135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:41.171135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:41.171135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:41.201236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-72648161-0236-47db-9ff6-bc5fed8cbad0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176502 Sep 19 15:30:41.206180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 538/1185] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:42.014091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:42.015324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:42.022049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:42.022539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:42.022978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:42.023670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:42.024126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:42.024573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:42.086711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:42.095939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7b2e64a2-c594-40b8-9def-76026b61feec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086224 Sep 19 15:30:42.096546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 648/1186] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:42.213415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:42.216328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:42.222818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:42.223357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:42.223733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:42.224424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:42.224984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:42.225406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:42.255671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-25e3ae17-5688-4478-8132-a7983e52ce79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046200 Sep 19 15:30:42.256282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 539/1187] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:43.127196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:43.127806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:43.134227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:43.134710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:43.135143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:43.135836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:43.136285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:43.136742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:43.197367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:43.205539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8a94d2a-3337-4035-8a9a-cb1ba88c9126 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082263 Sep 19 15:30:43.206093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 649/1188] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:43.267508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:43.269732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:43.276295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:43.276816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:43.277259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:43.278213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:43.279434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:43.279919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:43.311817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-08d1e5fd-48aa-46bc-807d-99ac8ab6fa72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048257 Sep 19 15:30:43.312384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 540/1189] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:44.228647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:44.229256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:44.236561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:44.237038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:44.237466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:44.238145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:44.238589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:44.239001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:44.307015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:44.314728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-77e7f658-2721-4963-92b9-5d80e3829853 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090008 Sep 19 15:30:44.315275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 650/1190] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:44.323225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:44.325686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:44.332859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:44.333346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:44.333786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:44.334481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:44.334939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:44.335369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:44.366125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b6552660-5db1-4acd-aeab-e0ac63721b2a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Sep 19 15:30:44.366686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 541/1191] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:45.337801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:45.338416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:45.344982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.345457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.345889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.346573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.347023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.347443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.379381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:45.381540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:45.387898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.388380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.388838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.389531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:45.389987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:45.390409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:45.409533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:45.417214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6b24cab4-d8f9-4b01-901f-3e8cd576f276 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083273 Sep 19 15:30:45.417782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 651/1192] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:45.419935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-396c4de2-1e04-4316-8558-0c1a398d8693 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043753 Sep 19 15:30:45.420500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 542/1193] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:46.432246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:46.435135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:46.440094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:46.444996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:46.445210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:46.445210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:46.445210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:46.445210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:46.445585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:46.445585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:46.447322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:46.447809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:46.449382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:46.449382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:46.449595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:46.449944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:46.475349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ba5fbb2c-904e-4248-9572-d58c5a543965 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047021 Sep 19 15:30:46.475921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 652/1194] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:46.518143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:46.526015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5ecb836a-1be6-4c5f-91c8-0906b96b2d0a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089802 Sep 19 15:30:46.526580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 543/1195] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:47.488267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:47.490480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:47.497192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.497669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.498118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.498859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.499315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.499742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.532155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5b10a4fc-45a7-4bf1-b5f7-7e2120bcce72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Sep 19 15:30:47.532737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 653/1196] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:47.548460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:47.549098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:47.555457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.555928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.556357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.557071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:47.557524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:47.557941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:47.618655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:47.626334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-db6303c5-da6d-4e71-b811-7f479322dc60 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082060 Sep 19 15:30:47.626889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 544/1197] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:48.545226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:48.547383 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:48.553872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:48.554353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:48.554788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:48.555485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:48.555943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:48.556371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:48.585433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d09f1530-9d0d-469b-b7e9-8a968bf2ada0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Sep 19 15:30:48.585979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 654/1198] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:48.649401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:48.650016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:48.652288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=59 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:48.657513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:48.657993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:48.658430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:48.659122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:48.659575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:48.659999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:48.724566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:48.733037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f5076592-3389-4688-bea6-f7e649258f03 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087509 Sep 19 15:30:48.733610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 545/1199] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:49.599475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:49.601904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:49.608424 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:49.608939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:49.609378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:49.610068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:49.610520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:49.610946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:49.641554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d6c88be8-747c-46e2-890b-aa547835e3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047582 Sep 19 15:30:49.642102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 655/1200] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:49.756436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:49.757059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:49.763397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:49.763866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:49.764295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:49.765011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:49.765461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:49.765880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:49.829675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:49.837251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9fb3c283-4c35-4a8b-b289-1d5c9e47f55e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084715 Sep 19 15:30:49.837805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 546/1201] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:50.654895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:50.657078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:50.663425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:50.663903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:50.664333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:50.665078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:50.665528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:50.665949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:50.694529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-02059c83-4e52-4d03-bae5-988c6dc05f9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Sep 19 15:30:50.695077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 656/1202] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:50.859765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:50.860369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:50.866700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:50.867175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:50.867604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:50.868582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:50.869027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:50.869450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:50.930961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:50.939130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7f8fbc68-1f5f-4eee-826a-05af2b7a530b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083435 Sep 19 15:30:50.939685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 547/1203] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:51.707242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:51.709412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:51.711705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=55 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:51.716887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:51.721606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:51.721606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:51.721606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:51.721606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:51.722051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:51.749698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-67433837-1b77-4a97-bc43-57e59225eef4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Sep 19 15:30:51.750258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 657/1204] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:30:51.961815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:51.962350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:51.969600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:51.970113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:51.970543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:51.971265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:51.971747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:51.972164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:52.033052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:52.040628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ed9bdc40-647d-4824-9727-964ea96eb3d0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082712 Sep 19 15:30:52.041187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 548/1205] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:52.762887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:52.764980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:52.771469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:52.771947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:52.772379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:52.773096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:52.773549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:52.773972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:52.803683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-87dff6f9-df52-4e55-a07b-39db4e3dd3e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Sep 19 15:30:52.804236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 658/1206] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:53.063811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:53.064444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:53.070973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:53.071453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:53.071890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:53.072613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:53.073076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:53.073525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:53.142860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:53.150798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0e670832-993f-47ec-9ff2-a481211525af tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090790 Sep 19 15:30:53.151365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 549/1207] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:53.815710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:53.817904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:53.824357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:53.825358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:53.825798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:53.826474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:53.826917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:53.827332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:53.856334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f9de6aa4-2c09-4c19-8e44-e6c34544d825 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Sep 19 15:30:53.856903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 659/1208] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:54.173758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:54.174365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:54.180838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:54.181321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:54.181747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:54.182432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:54.182883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:54.183303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:54.243996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:54.253013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-310ad414-6f91-4338-86e6-579a3a22bee9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083396 Sep 19 15:30:54.253572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 550/1209] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:54.869149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:54.871336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:54.877779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:54.878260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:54.878692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:54.879382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:54.879828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:54.880248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:54.905073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:54.909733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-97afe585-9364-420c-9835-47e28e5bba4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 19 15:30:54.910279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 660/1210] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:55.275537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:55.276163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:55.283460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:55.283945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:55.284384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:55.285111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:55.285571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:55.285999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:55.346922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:55.354733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dbf45c26-4b16-418b-8b25-777ac07cdeb6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083120 Sep 19 15:30:55.355297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 551/1211] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:55.923313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:55.925659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:55.932456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:55.933001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:55.933430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:55.934167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:55.934609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:55.935031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:55.964995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-99df694e-2aaa-4c09-9719-fb63413fbbe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046551 Sep 19 15:30:55.965593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 661/1212] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:56.377778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:56.380805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:56.384595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:56.385079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:56.385512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:56.386203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:56.386657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:56.387074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:56.391054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:30:56.450676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:56.458943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6b617d24-c0bf-4c9e-8e12-0a4eb575631e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085054 Sep 19 15:30:56.459495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 552/1213] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:56.977788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:56.979934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:56.986475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:56.986947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:56.987373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:56.988090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:56.988586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:56.989002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:57.019353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7a146773-381a-44dc-b58c-8e1a01b8eb13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Sep 19 15:30:57.019896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 662/1214] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:57.482315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:57.482923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:57.490361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:57.490837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:57.492793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:57.492793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:57.492793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:57.493368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:57.559185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:57.566909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ab64fcbb-563e-4cb8-90ba-34e95dcc0cdd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088567 Sep 19 15:30:57.567467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 553/1215] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:58.032190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:58.034350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:58.040756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:58.041231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:58.041668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:58.042349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:58.042799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:58.043217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:58.072754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ab8b1eb7-22d4-4ca0-9f9d-1ef3854e6e60 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044973 Sep 19 15:30:58.073309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 663/1216] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:58.590050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:58.590673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:58.597703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:58.598187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:58.598629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:58.599325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:58.599782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:58.600206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:58.661050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:58.668789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2a9db061-ba38-45c5-b948-42f06aba90ee tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082621 Sep 19 15:30:58.669342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 554/1217] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:30:59.085037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:59.087244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:59.093891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.094475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.095045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.095754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.096212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.096674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.127877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-087cb417-374f-4ae4-a980-2efd2bf11426 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046986 Sep 19 15:30:59.129264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 664/1218] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:30:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:30:59.691972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:30:59.692638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:30:59.699192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.699670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.700101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.700817 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:30:59.701268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:30:59.701688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:30:59.764684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:30:59.773173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1017184c-d152-400f-8e79-e82a9ba421f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085190 Sep 19 15:30:59.773748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 555/1219] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:30:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:00.141627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:00.143782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:00.150898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:00.151377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:00.151813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:00.152562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:00.153014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:00.153436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:00.188598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d000a779-9e74-47ed-9d0d-8ae061618b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050929 Sep 19 15:31:00.189175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 665/1220] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:00.796350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:00.796995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:00.804430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:00.804938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:00.805372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:00.806061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:00.806512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:00.806937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:00.866716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:00.875223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b1cd0b64-bd57-48d4-bd56-e20f9a1affba tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082706 Sep 19 15:31:00.875782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 556/1221] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:01.201810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:01.203952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:01.210896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.211392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.211817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.212521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.212997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.213415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.243402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-29d08c36-ef1b-4dd9-8d42-1965e488af16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Sep 19 15:31:01.257500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 666/1222] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:01.898748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:01.899371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:01.905836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.906333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.906774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.907480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:01.907941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:01.908372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:01.976198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:01.983824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-df18e791-8325-49f4-8a18-399756209b86 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089700 Sep 19 15:31:01.993466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 557/1223] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:02.256104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:02.258283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:02.264720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:02.265193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:02.265622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:02.266299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:02.266742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:02.267155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:02.296050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-199c3649-7cc9-4cb9-8498-d6064602e835 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Sep 19 15:31:02.296614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 667/1224] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:03.006750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:03.007359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:03.013831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:03.014303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:03.014731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:03.015413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:03.015860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:03.016276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:03.080178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:03.088953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4d79d0f0-4302-4e21-87db-9711f4302a9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086659 Sep 19 15:31:03.089519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 558/1225] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:03.308793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:03.311027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:03.317666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:03.318720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:03.319247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:03.319945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:03.320399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:03.320858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:03.353266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a9149e3d-d19d-48df-881e-789eaab5f508 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047977 Sep 19 15:31:03.353905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 668/1226] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:04.111146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:04.111762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:04.119291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:04.119775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:04.120212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:04.120953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:04.121410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:04.121849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:04.183263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:04.190821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d44c45b1-d07d-4ffb-9b37-0feb37561e78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083570 Sep 19 15:31:04.191382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 559/1227] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:04.366093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:04.368455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:04.375111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:04.375590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:04.376023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:04.376756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:04.377208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:04.377633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:04.409096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-318d32d7-99b3-40ca-b039-1a45f687b80c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047070 Sep 19 15:31:04.409662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 669/1228] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:05.213537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:05.214150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:05.220532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:05.221017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:05.221447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:05.222135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:05.222589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:05.223018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:05.283472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:05.291816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c6e6270b-b7a0-43f0-81be-1241ae9cc082 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082359 Sep 19 15:31:05.292381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 560/1229] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:05.421727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:05.423958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:05.431017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:05.431519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:05.431950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:05.432677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:05.433134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:05.433558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:05.462405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4137c2ba-06dd-40da-8f31-a059c64ee674 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Sep 19 15:31:05.462951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 670/1230] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:06.315233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:06.315836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:06.322454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:06.322933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:06.323364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:06.324048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:06.324516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:06.324937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:06.389006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:06.397350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7c4a98b5-d010-4a1e-8695-f84447c61c17 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085590 Sep 19 15:31:06.397933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 561/1231] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:06.475384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:06.477745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:06.483882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:06.484356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:06.484829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:06.485511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:06.485952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:06.486369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:06.515983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-61df86d8-48b1-4ccc-af57-7fa184813c23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Sep 19 15:31:06.516542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 671/1232] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:07.420843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:07.421508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:07.428579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.429076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.429554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.430253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.430707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.431178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.500308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:07.509049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-62949a4e-1626-4ba2-af6c-7557924034d1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.092342 Sep 19 15:31:07.509614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 562/1233] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:07.529072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:07.531240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:07.537708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.538146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.538577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.539295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:07.539739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:07.540154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:07.569585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c0cc7eef-f3aa-4b86-92cb-1036210723ae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Sep 19 15:31:07.570144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 672/1234] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:08.532592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:08.533210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:08.540209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:08.540733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:08.541165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:08.541870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:08.542318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:08.542741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:08.582133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:08.584937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:08.591961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:08.592453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:08.592909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:08.593618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:08.594063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:08.594481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:08.611005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:08.620032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-86ec0061-d565-491c-b58e-3d8b4b4dcb41 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091422 Sep 19 15:31:08.622445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 563/1235] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:08.627374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bd444392-ecbb-4a83-90d4-0d3b83227b34 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049096 Sep 19 15:31:08.628166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 673/1236] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:09.641338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:09.643522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:09.643948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:09.644617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:09.650750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:09.651247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:09.651688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:09.652399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:09.652837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:09.652990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:09.653302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:09.653436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:09.653786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:09.654522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:09.654979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:09.655445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:09.684133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-251203b0-7861-466b-9024-902ae5fb5adc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Sep 19 15:31:09.684739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 564/1237] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:09.717447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:09.725122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c8f3d94c-091c-457e-bb9a-e2fc8ada5a4b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085006 Sep 19 15:31:09.725683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 674/1238] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:31:10.697312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:10.699478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:10.706181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:10.706664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:10.707101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:10.707833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:10.708290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:10.708745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:10.738717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-67a8298f-7bc1-4ec0-82cb-16294ee6f129 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Sep 19 15:31:10.739275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 565/1239] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:10.747308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:10.747925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:10.754394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:10.754867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:10.755298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:10.756562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:10.757005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:10.757419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:10.821899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:10.829555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-eac2f691-52d4-4f63-9999-94a84ee56112 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086351 Sep 19 15:31:10.830109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 675/1240] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:11.751398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:11.753684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:11.761083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:11.761501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:11.761971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:11.762671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:11.763123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:11.763544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:11.797138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cafd9ad8-89cc-45f3-a14d-3249840d7700 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049677 Sep 19 15:31:11.797695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 566/1241] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:11.852992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:11.853606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:11.860073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:11.860575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:11.861011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:11.861698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:11.862145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:11.862563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:11.923023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:11.931354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-89f4a2fa-9e3f-42b8-b5ae-bfd21d27e242 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082387 Sep 19 15:31:11.931907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 676/1242] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:12.810151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:12.812457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:12.820049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:12.820600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:12.821064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:12.821793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:12.822273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:12.822779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:12.855977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8cf9a2ee-06d7-45aa-bd80-14b930379daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050060 Sep 19 15:31:12.856557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 567/1243] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:12.956746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:12.957357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:12.965887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:12.966360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:12.966788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:12.967470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:12.967914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:12.968327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:12.985781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:13.030967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:13.038522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a1109e6f-a722-4308-b54b-560d73eed07d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087421 Sep 19 15:31:13.039082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 677/1244] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:13.869521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:13.871682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:13.878176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:13.878655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:13.879087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:13.879784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:13.880234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:13.880683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:13.905535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:13.910079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-649df33e-23d9-4a8a-be91-68fcd028ca9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Sep 19 15:31:13.910629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 568/1245] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:14.061104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:14.061658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:14.068587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:14.069066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:14.069639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:14.070398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:14.070848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:14.071269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:14.135079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:14.142772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c78c187c-fdda-438d-8637-e9c6f26be701 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085636 Sep 19 15:31:14.143330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 678/1246] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:14.931388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:14.933595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:14.940666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:14.941142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:14.941574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:14.942357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:14.942713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:14.943135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:14.973716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ce9f936f-7e65-49fe-9bf0-4444399ecfa3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047190 Sep 19 15:31:14.974273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 569/1247] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:15.166745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:15.167354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:15.173722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:15.174196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:15.174624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:15.175302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:15.175748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:15.176164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:15.239343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:15.247875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0f5e536c-ad8f-4900-b2f7-7d4b785d071c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085548 Sep 19 15:31:15.248433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 679/1248] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:15.987222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:15.989409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:15.996104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:15.996619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:15.997055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:15.997773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:15.998222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:15.998643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:16.029371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-909411eb-43ee-41d9-9d1c-4985f360a199 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Sep 19 15:31:16.029838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 570/1249] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:16.269692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:16.270299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:16.276753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:16.277226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:16.277658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:16.278337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:16.278781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:16.279193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:16.339743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:16.347389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-050f5548-acd8-42b0-ae12-ee0033ae4791 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081607 Sep 19 15:31:16.347945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 680/1250] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:17.042586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:17.044716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:17.051085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:17.051565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:17.052000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:17.052719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:17.053170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:17.053597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:17.082212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0ea6aaf3-c71e-4b32-bc08-8dc0e72e9b0f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Sep 19 15:31:17.082754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 571/1251] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:17.370494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:17.371106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:17.377533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:17.378006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:17.378434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:17.379113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:17.379556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:17.379973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:17.455255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:17.458663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-24ff60bd-87ec-4b7b-95a4-a41bca030cdf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.092524 Sep 19 15:31:17.459224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 681/1252] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:18.094725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:18.096952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:18.103867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:18.104348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:18.104814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:18.105518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:18.105967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:18.106390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:18.135858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-031a39ff-f08a-46b2-b96a-2b6f98f8ac3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045127 Sep 19 15:31:18.136407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 572/1253] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:18.483069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:18.483609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:18.489955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:18.490428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:18.490858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:18.491537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:18.491981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:18.492397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:18.564927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:18.572582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-02999f12-539b-4550-81f3-d89175e81370 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.093505 Sep 19 15:31:18.573136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 682/1254] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:19.148241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:19.150470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:19.152805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=56 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:19.157429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:19.157906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:19.158344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:19.159028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:19.159476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:19.159897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:19.189498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-463cc1a0-656d-435d-b6b4-1edc341fad50 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Sep 19 15:31:19.190043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 573/1255] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:19.595464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:19.596068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:19.602445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:19.603520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:19.603959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:19.604675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:19.605121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:19.605539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:19.669186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:19.676789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e8725ded-59c1-48ed-a0cd-a35798d5ee62 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085179 Sep 19 15:31:19.677362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 683/1256] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:20.202680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:20.204903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:20.211436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:20.211916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:20.213013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:20.213709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:20.214163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:20.214590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:20.242704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5cb993c9-e3fb-4825-bf9f-0f553c26896f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Sep 19 15:31:20.243500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 574/1257] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:20.699826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:20.700421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:20.706744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:20.707214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:20.707639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:20.708322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:20.708789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:20.709206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:20.770034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:20.777825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-990e3ea3-d663-4fbd-b0df-34cd879e3c28 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082560 Sep 19 15:31:20.778509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 684/1258] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:21.255372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:21.257686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:21.264737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:21.265224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:21.265661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:21.266356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:21.266812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:21.267244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:21.298333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b5ccdef-dec4-4d45-ae86-b670025c653b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 Sep 19 15:31:21.298916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 575/1259] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:21.800527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:21.801152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:21.803432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=56 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:21.808804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:21.809559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:21.810001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:21.810699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:21.811152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:21.811576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:21.878584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:21.886379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-965ed936-6c22-4716-96f0-4ff74b9bcf93 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089765 Sep 19 15:31:21.886935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 685/1260] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:22.280130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:22.280747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:22.287040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:22.287519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:22.287956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:22.288687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:22.289139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:22.289561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:22.310186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:22.312355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:22.313180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1902ad16-56e6-478b-9fe6-862b8ea091fa tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190/ips" status: 200 len: 150 microversion: 2.20 time: 0.036996 Sep 19 15:31:22.313784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 576/1261] 10.222.0.75 () {60 vars in 1289 bytes} [Mon Sep 19 15:31:22 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:31:22.318575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:22.319054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:22.319486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:22.320267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:22.320811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:22.321236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:22.350946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7803a4b8-92a9-41c6-add9-0ad3eada0c1b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Sep 19 15:31:22.351504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 686/1262] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:22.908933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:22.909551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:22.916152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:22.916665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:22.917106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:22.917807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:22.918274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:22.918694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:22.978881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:22.986503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-76513221-ee08-44ce-8a58-bd5d6b661d85 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081588 Sep 19 15:31:22.987065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 577/1263] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:23.364211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:23.366429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:23.373200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:23.373679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:23.374117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:23.374808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:23.375262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:23.375684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:23.405650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-22d35109-f604-4001-8baa-fb3e2939cb88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Sep 19 15:31:23.406208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 687/1264] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:24.009249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:24.009960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:24.016316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:24.016825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:24.017253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:24.017936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:24.018384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:24.018801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:24.083390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:24.091069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe62be50-7961-4a33-bbd1-360c979cb00f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085850 Sep 19 15:31:24.091636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 578/1265] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:24.418300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:24.420378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:24.427682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:24.428159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:24.428618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:24.429366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:24.429815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:24.430386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:24.460669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-80e06cf4-f30f-4ca2-bf8b-1389fda25a77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Sep 19 15:31:24.461229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 688/1266] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:25.114206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:25.114851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:25.121932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:25.122414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:25.122849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:25.123541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:25.123993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:25.124413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:25.184496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:25.192079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0e147c12-c955-4d95-b41d-c72f23329239 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081769 Sep 19 15:31:25.192669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 579/1267] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:25.473799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:25.475872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:25.483156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:25.483639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:25.484072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:25.484813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:25.485272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:25.485700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:25.515712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-860189cf-32b7-40fd-bf7d-6f878932f703 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046046 Sep 19 15:31:25.516266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 689/1268] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:25.720678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:25.721166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:25.727149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:25.728264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:25.728725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:25.729436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:25.729881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:25.730297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:25.753475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2f4687e-ddc5-4096-8270-9edc126c3d0f tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f/ips" status: 200 len: 145 microversion: 2.1 time: 0.036652 Sep 19 15:31:25.754039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 580/1269] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:31:25 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:26.216040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:26.216690 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:26.222513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:26.222981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:26.223412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:26.224088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:26.224560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:26.224978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:26.288090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:26.295864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-38d3d4fe-d9cf-4bb8-9f07-3a972e66e7ab tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084328 Sep 19 15:31:26.296419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 690/1270] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:26.528596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:26.530687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:26.537034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:26.537508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:26.537934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:26.538616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:26.539062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:26.539480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:26.568378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1f2590b9-9b52-4912-bcf3-748cfd48a0f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Sep 19 15:31:26.568965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 581/1271] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:27.318714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:27.319320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:27.325777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:27.326245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:27.326671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:27.327347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:27.327792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:27.328205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:27.389116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:27.396801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0d2848f7-f58b-4542-a2f7-e3739867f217 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082030 Sep 19 15:31:27.397359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 691/1272] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:27.581880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:27.583966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:27.590997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:27.591476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:27.591937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:27.592659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:27.593113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:27.593535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:27.622842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bff7606c-2aee-48bb-bfbd-eba33e143217 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Sep 19 15:31:27.623390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 582/1273] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:28.420587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:28.421218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:28.427594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:28.428068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:28.428519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:28.429200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:28.429642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:28.430056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:28.494404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:28.502074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-538c64ce-054b-4245-9c6f-8edac9241329 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085689 Sep 19 15:31:28.502621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 692/1274] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:28.635627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:28.639035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:28.648260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:28.648772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:28.649210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:28.649915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:28.650374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:28.650794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:28.683521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f8d90226-f481-45e0-87e1-fc47045c868c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051972 Sep 19 15:31:28.683994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 583/1275] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:29.528018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:29.528668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:29.535289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:29.535768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:29.536204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:29.536932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:29.537386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:29.537803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:29.599046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:29.607853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-682ec5b5-8227-4719-8048-e8d1a5d806cd tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085840 Sep 19 15:31:29.608422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 693/1276] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:29.695283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:29.698486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:29.704843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:29.705334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:29.705771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:29.706463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:29.706926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:29.707339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:29.736224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fa936d96-e35d-4abb-be32-6ac36a7872c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044984 Sep 19 15:31:29.736806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 584/1277] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:30.631286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:30.631896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:30.638363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:30.638843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:30.639281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:30.639973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:30.640426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:30.640877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:30.644766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:30.702457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:30.710126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-41c55c94-9834-4b68-ab11-6b39a5b3c0c6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082830 Sep 19 15:31:30.710687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 694/1278] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:30.748829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:30.750989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:30.757321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:30.757793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:30.758219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:30.759409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:30.759860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:30.760279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:30.789798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3bea8a9d-1551-474f-ad41-4d6599dd9849 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Sep 19 15:31:30.790351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 585/1279] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:31.733563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:31.734174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:31.740647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:31.741121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:31.741552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:31.742235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:31.742682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:31.743700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:31.802478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:31.804038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:31.804744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:31.812113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:31.812716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:31.812849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ecd816ff-d41b-4bfe-968e-166179226cc8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083180 Sep 19 15:31:31.813176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:31.824502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 695/1280] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:31.824685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:31.824685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:31.824685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:31.824685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:31.844715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4734f800-894b-44cc-a2b5-f1c2360db651 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Sep 19 15:31:31.845279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 586/1281] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:32.836160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:32.837360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:32.843881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:32.844364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:32.844834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:32.845527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:32.845981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:32.846409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:32.857724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:32.859899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:32.866753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:32.867240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:32.867682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:32.868955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:32.869391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:32.869820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:32.901598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3665accf-18de-4060-a4d0-637d8b2f1621 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048660 Sep 19 15:31:32.902164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 587/1282] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:32.913373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:32.921833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-add4fde8-d5e9-4310-992f-23461a07aedb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089581 Sep 19 15:31:32.922384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 696/1283] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:33.914305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:33.918749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:33.926375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:33.926859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:33.927307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:33.928002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:33.928460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:33.928907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:33.944188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:33.944818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:33.951616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:33.952088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:33.952534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:33.953226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:33.953671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:33.954084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:33.958994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5fd93adb-998d-4d7b-b69a-d243853808e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048712 Sep 19 15:31:33.959553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 588/1284] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:34.014632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:34.022226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ac9a63b8-7422-4c4c-a7b8-5dee3185922c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081898 Sep 19 15:31:34.022772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 697/1285] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:31:34.971344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:34.973553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:34.980723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:34.981208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:34.981639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:34.982324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:34.982772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:34.983192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:35.012271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ead58909-d2f6-4e14-9eb4-54f3cc2c62a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Sep 19 15:31:35.012848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 589/1286] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:35.045030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:35.045581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:35.051978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:35.052505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:35.052946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:35.053632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:35.054180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:35.054608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:35.115915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:35.123820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b762151e-21f7-4c51-8272-4a6fb376338b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082756 Sep 19 15:31:35.124373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 698/1287] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:36.025254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:36.027405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:36.033602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:36.034028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:36.034456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:36.035132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:36.035577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:36.035994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:36.065948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-efaac729-481f-4357-a599-df26d70069c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Sep 19 15:31:36.066495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 590/1288] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:36.145941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:36.146559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:36.153238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:36.153722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:36.154154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:36.154845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:36.155299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:36.155723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:36.215787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:36.223484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ce9af3df-d99b-467b-b4d2-5f9d2e824ab8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081418 Sep 19 15:31:36.224043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 699/1289] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:37.078981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:37.081231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:37.087774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:37.088309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:37.089493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:37.090185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:37.090633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:37.091053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:37.119901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a6a2dc28-aaf2-4c0e-90d0-416f8e0473ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Sep 19 15:31:37.120442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 591/1290] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:37.246562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:37.247168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:37.253244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:37.253715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:37.254142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:37.254854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:37.255297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:37.255713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:37.318225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:37.326724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0a0b99b5-c808-4106-8faf-9eddcfc5dabc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084280 Sep 19 15:31:37.327289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 700/1291] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:38.132326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:38.134504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:38.141050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:38.141527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:38.141957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:38.142641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:38.143089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:38.143508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:38.172845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a88ea5b6-a0f6-46eb-9cc8-9640f479c8ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Sep 19 15:31:38.173380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 592/1292] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:38.350180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:38.350809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:38.357920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:38.358401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:38.358839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:38.359529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:38.359980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:38.360403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:38.659837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:38.667843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0b281796-a992-4eaf-918d-e54ef8a0cc47 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.321519 Sep 19 15:31:38.668410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 701/1293] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:39.186108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:39.188370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:39.194760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:39.195236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:39.195672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:39.196352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:39.196828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:39.197245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:39.226521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4a083002-84aa-448d-962c-b29b036a8664 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Sep 19 15:31:39.227063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 593/1294] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:39.690185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:39.690825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:39.697212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:39.697761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:39.698388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:39.699071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:39.699520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:39.699937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:39.761191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:39.768815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-27af43df-e22e-421f-88aa-507bcadb2de0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082562 Sep 19 15:31:39.769369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 702/1295] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:40.239004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:40.241176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:40.248211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:40.248743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:40.249185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:40.249895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:40.250354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:40.250788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:40.281637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b5ebc334-9151-4fbb-bbac-6df5f97b2ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Sep 19 15:31:40.282184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 594/1296] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:40.793143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:40.793769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:40.800155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:40.800675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:40.801117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:40.801814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:40.802270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:40.802693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:40.866494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:40.875086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-82b28e5d-24b1-4ab5-b504-0bfcfb33f62b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086782 Sep 19 15:31:40.875645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 703/1297] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:41.294871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:41.297119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:41.303575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:41.304059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:41.304521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:41.305225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:41.305683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:41.306109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:41.337157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7e207566-0e7c-4e1f-9cb0-dd60592e547d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Sep 19 15:31:41.337722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 595/1298] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:41.897772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:41.898389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:41.907182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:41.907672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:41.908111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:41.908833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:41.909287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:41.909709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:41.975002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:41.982746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d3d1fe93-cc64-4926-9671-6a2169900908 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088900 Sep 19 15:31:41.983301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 704/1299] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:42.350317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:42.352464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:42.359212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:42.361380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:42.361380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:42.361380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:42.361380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:42.361890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:42.391364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-335e8d6b-e3ca-4f5e-8a91-59be5bfade09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Sep 19 15:31:42.391921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 596/1300] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:43.006239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:43.006857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:43.013952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:43.014434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:43.014872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:43.015567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:43.016021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:43.016445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:43.079209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:43.086961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7fe7af0f-2d02-478a-b739-4ca6d23d564f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084653 Sep 19 15:31:43.087527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 705/1301] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:43.404298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:43.406411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:43.412857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:43.413344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:43.413783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:43.414479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:43.414937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:43.415365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:43.444834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2a5d98b-98b0-4f70-8593-fa39b2576a41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Sep 19 15:31:43.445412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 597/1302] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:44.110462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:44.111123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:44.117513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:44.118026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:44.118724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:44.119419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:44.119869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:44.120293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:44.181699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:44.189664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e35f0813-030a-4482-b6b4-e61f024c2072 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083925 Sep 19 15:31:44.190228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 706/1303] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:31:44.458111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:44.460256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:44.466974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:44.468421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:44.468903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:44.469606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:44.470058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:44.470483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:44.499746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-944186c1-2f71-4b9f-8e12-4d8efe286455 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Sep 19 15:31:44.500300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 598/1304] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:45.212358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:45.212993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:45.219501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:45.219976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:45.220404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:45.221122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:45.221572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:45.221987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:45.282920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:45.290557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a33fe3e-54d8-4a4a-ab25-1417f8aea57f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082050 Sep 19 15:31:45.291120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 707/1305] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:45.512030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:45.514132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:45.520457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:45.520954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:45.521385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:45.522066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:45.522512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:45.522960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:45.552625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d221f8c4-6751-4be2-8464-e728d33b2359 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 19 15:31:45.553190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 599/1306] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:46.314750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:46.315395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:46.321883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:46.322364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:46.322805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:46.323496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:46.323951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:46.324375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:46.385933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:46.394732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8983a09-0b98-411d-90dc-27c12bae3c74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084812 Sep 19 15:31:46.395301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 708/1307] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:46.565463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:46.567575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:46.574236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:46.578316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:46.578316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:46.578316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:46.578316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:46.578772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:46.606930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bcbc76f7-cd38-4c24-9ad4-0fd053f6048b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Sep 19 15:31:46.607484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 600/1308] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:47.417444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:47.418072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:47.425079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:47.425537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:47.425973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:47.426665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:47.427117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:47.427543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:47.490670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:47.498681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bfcacf96-d949-49b1-b2cc-7539fa2f36bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085141 Sep 19 15:31:47.499239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 709/1309] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:47.619652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:47.621833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:47.628141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:47.628656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:47.629089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:47.629773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:47.630219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:47.630637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:47.660731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6e51684e-3206-4b18-af19-6f176c1483ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Sep 19 15:31:47.661288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 601/1310] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:48.523024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:48.523717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:48.531913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:48.532636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:48.533274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:48.534394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:48.535238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:48.535846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:48.603543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:48.608217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:48.613316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0cb17f5-3529-4893-9606-f910a231beca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.095023 Sep 19 15:31:48.613881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 710/1311] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:48.674616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:48.677118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:48.683585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:48.684152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:48.684688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:48.685415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:48.685907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:48.686420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:48.711520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:48.716257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-855cc8f3-3f9e-4396-ab73-f8fb7e25c718 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Sep 19 15:31:48.717565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 602/1312] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:49.643890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:49.644523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:49.651512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:49.651994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:49.652425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:49.653143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:49.653592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:49.654013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:49.714617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:49.722600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-91637728-1ddf-45f2-89ca-01adf9ad8974 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082558 Sep 19 15:31:49.723180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 711/1313] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:49.729123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:49.731383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:49.738650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:49.739201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:49.739700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:49.740394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:49.740868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:49.741296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:49.770696 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8dc76e3d-710f-47ae-bb5d-c8bc03eb3318 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Sep 19 15:31:49.771246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 603/1314] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:50.745470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:50.746087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:50.752935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:50.753421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:50.753857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:50.754559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:50.755012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:50.755437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:50.783590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:50.785839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:50.788136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=62 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:50.792907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:50.795774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:50.795774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:50.795774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:50.795774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:50.796224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:50.818969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:50.825839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2eb26c55-0ae0-4914-9ae0-1c2aa5b73742 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Sep 19 15:31:50.827006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 604/1315] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:50.827608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-19129513-937b-4022-9613-f242d486165e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086223 Sep 19 15:31:50.828246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 712/1316] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:51.838054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:51.840262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:51.847764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:51.848252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:51.848724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:51.849430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:51.849885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:51.850311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:51.851008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:51.851655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:51.853969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=56 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:31:51.859413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:51.860071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:51.860526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:51.861228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:51.861683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:51.862104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:51.881900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ef37fa04-91e5-43d0-9105-a71303f8ab6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047803 Sep 19 15:31:51.882500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 605/1317] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:51.927113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:51.934946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fed4835c-e62e-4318-b228-ae968b674057 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087684 Sep 19 15:31:51.936150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 713/1318] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:31:52.894223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:52.896395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:52.903143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:52.903260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:52.903687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:52.904411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:52.904901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:52.905362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:52.935063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f68b9fd4-8ac0-4310-8fcf-cfb0f3caa58e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Sep 19 15:31:52.936316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 606/1319] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:52.957938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:52.958704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:52.965085 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:52.965569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:52.966008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:52.966738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:52.967186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:52.967616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:53.028904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:53.036746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7735aacd-b38e-4248-9945-6e58eb226a20 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082621 Sep 19 15:31:53.037336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 714/1320] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:53.948428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:53.950612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:53.960807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:53.961294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:53.961730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:53.962432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:53.962888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:53.963316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:53.992730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d2a743d7-592f-49c5-86e1-66e42c67e2ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048329 Sep 19 15:31:53.993277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 607/1321] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:31:54.059946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:54.061052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:54.067411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:54.067892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:54.068326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:54.069049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:54.069507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:54.069929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:54.131277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:54.140034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8deab6d6-3534-47b7-af4f-ad5c775134ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084012 Sep 19 15:31:54.140626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 715/1322] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:55.005615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:55.007852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:55.014856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:55.015318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:55.015753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:55.016449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:55.016930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:55.017366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:55.047077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e50b1b1c-bcce-4235-bc18-9295e621e54e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Sep 19 15:31:55.047552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 608/1323] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:55.162627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:55.163261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:55.169638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:55.170128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:55.170555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:55.171246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:55.171692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:55.172111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:55.236074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:55.244013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8536e502-dcda-4be4-877a-b1e54d1ba48d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084946 Sep 19 15:31:55.244600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 716/1324] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:56.059005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:56.061737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:56.068169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:56.071377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:56.071377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:56.071377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:56.071377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:56.071902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:56.100567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-742e10e1-3905-439c-8d1c-d36e536ed040 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Sep 19 15:31:56.101100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 609/1325] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:56.265654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:56.266262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:56.272660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:56.273137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:56.273564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:56.274248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:56.274696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:56.275121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:56.338292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:56.346687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bac292c9-dff0-4aa4-b312-7099397ece65 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084976 Sep 19 15:31:56.347286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 717/1326] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:57.113081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:57.115245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:57.122092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:57.122570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:57.123584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:57.124283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:57.124770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:57.125200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:57.154748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-41a69e2c-b449-44e5-86b1-5a6675b8988f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Sep 19 15:31:57.155291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 610/1327] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:57.369763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:57.370278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:57.377345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:57.377822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:57.378524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:57.379216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:57.379664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:57.380084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:57.441275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:57.448961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fab0e3b0-6dc5-45e9-b5e6-11a152d33b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083431 Sep 19 15:31:57.449517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 718/1328] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:58.167422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:58.170113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:58.176603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:58.177088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:58.177527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:58.178216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:58.178672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:58.179099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:58.209154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-866f8b7d-c0a2-442e-bc0a-9494ed58e4d7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Sep 19 15:31:58.209715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 611/1329] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:58.471706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:58.472234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:58.478674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:58.479156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:58.479591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:58.480280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:58.480761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:58.481193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:58.542464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:58.550817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cfeca1b3-27bc-43e0-b7f3-68c34c9c9453 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083985 Sep 19 15:31:58.551380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 719/1330] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:31:59.221735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:59.223934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:59.230363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:59.230848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:59.231282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:59.231977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:59.232511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:59.233019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:59.262536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-85002da6-3940-45f9-9373-b22923571c24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Sep 19 15:31:59.263080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 612/1331] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:31:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:31:59.573662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:31:59.574274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:31:59.580684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:59.581157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:59.581582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:59.582264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:31:59.582711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:31:59.583128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:31:59.654210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:31:59.683903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1bd5fbaa-5e7f-481d-acb4-2ecfb184560b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.093729 Sep 19 15:31:59.683903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 720/1332] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:31:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:00.275671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:00.277891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:00.284990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:00.285474 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:00.285948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:00.286646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:00.287103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:00.287532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:00.316169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-246a22bd-03f6-4d3a-b4ad-13cb15c61656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Sep 19 15:32:00.316760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 613/1333] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:00.688973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:00.689593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:00.696065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:00.696740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:00.697190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:00.697884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:00.698341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:00.698766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:00.762503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:00.770850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-64c7b190-7245-4b45-9a75-524b556375d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086576 Sep 19 15:32:00.771410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 721/1334] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:01.329630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:01.331819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:01.338471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:01.338957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:01.339394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:01.340090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:01.340583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:01.341013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:01.370318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f513994f-9f0a-4314-9fe8-2fe7fec05cf3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Sep 19 15:32:01.370802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 614/1335] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:01.793025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:01.793664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:01.800124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:01.800632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:01.801059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:01.801737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:01.802183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:01.802597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:01.863713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:01.871903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ae3df4a0-f352-4c37-8805-0a481e20a429 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082705 Sep 19 15:32:01.872463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 722/1336] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:02.383406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:02.385651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:02.393302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:02.393849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:02.394274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:02.395098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:02.395558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:02.395981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:02.425520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d8464667-5868-4db5-9ff7-1f6ee3a8cc6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Sep 19 15:32:02.426071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 615/1337] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:02.895478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:02.896237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:02.902648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:02.903125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:02.903559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:02.904947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:02.905414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:02.905840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:02.986030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:02.994059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-991145dc-29ae-49d2-894f-ee3c208d7897 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.102184 Sep 19 15:32:02.994632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 723/1338] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:03.438830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:03.441023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:03.447427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:03.447913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:03.448347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:03.449081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:03.449531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:03.449955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:03.478441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0887d411-7677-4900-8ec5-0c2efa73a2cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Sep 19 15:32:03.478993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 616/1339] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:04.018368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:04.018994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:04.025461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:04.025939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:04.026373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:04.027056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:04.027508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:04.027929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:04.096052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:04.104036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4cb7f1c3-67c9-4649-8673-70964eebac6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089615 Sep 19 15:32:04.104623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 724/1340] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:04.491551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:04.493964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:04.500839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:04.501316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:04.501750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:04.502438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:04.502891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:04.503313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:04.532282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cd904031-ee88-4e75-a563-b0dd1b8da7fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Sep 19 15:32:04.532856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 617/1341] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:05.127196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:05.127815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:05.134217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:05.134701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:05.135139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:05.135828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:05.136316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:05.136769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:05.198153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:05.205970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d140f263-3cf3-4cf3-9722-ea5f02f9dc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082762 Sep 19 15:32:05.206534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 725/1342] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:05.545289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:05.547439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:05.553845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:05.554326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:05.554760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:05.555448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:05.555898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:05.556320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:05.585680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3d59ae9d-ef06-46e1-bcb4-ff002aeb75fe tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Sep 19 15:32:05.586230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 618/1343] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:06.229356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:06.229970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:06.237039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:06.237540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:06.237959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:06.238650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:06.239101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:06.239522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:06.300271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:06.307768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f886f2e4-2df1-4bee-a212-9ab9d77b7b29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082389 Sep 19 15:32:06.308336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 726/1344] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:06.598776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:06.601029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:06.607519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:06.608017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:06.608450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:06.609163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:06.609615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:06.610041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:06.627378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:06.640869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5358d47f-0744-43ba-b6e8-f0d37dee4b54 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Sep 19 15:32:06.641431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 619/1345] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:07.331746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:07.332355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:07.338412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:07.338883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:07.339311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:07.339986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:07.340434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:07.340872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:07.358699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:07.402012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:07.409675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d683e993-1517-49fb-9d76-9b00cc21a6c7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081894 Sep 19 15:32:07.410228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 727/1346] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:07.653091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:07.655242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:07.662091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:07.662564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:07.662993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:07.663675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:07.664121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:07.664634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:07.695062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7d9500e0-6838-44ec-920e-d107c21e760e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Sep 19 15:32:07.695705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 620/1347] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:08.431238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:08.431901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:08.439541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:08.440017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:08.440452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:08.441163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:08.441611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:08.442031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:08.505776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:08.514143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a045e716-3ec3-4ee1-8697-e728130f4f5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086206 Sep 19 15:32:08.514706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 728/1348] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:08.707983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:08.710110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:08.717127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:08.717613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:08.718049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:08.718744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:08.719200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:08.719626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:08.750660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c6431e36-cdaf-42e0-a161-3ce6b2241bde tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046647 Sep 19 15:32:08.751230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 621/1349] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:09.537320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:09.538151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:09.544855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:09.545515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:09.545950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:09.546648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:09.547102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:09.547524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:09.611250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:09.619212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b6ff08fa-46eb-4e6f-af17-3cf6e044ba9d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085959 Sep 19 15:32:09.619779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 729/1350] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:09.766129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:09.768223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:09.774782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:09.775264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:09.775695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:09.776397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:09.776880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:09.777306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:09.807123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-62ba1575-36c9-476a-9a97-1f35cd800469 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 19 15:32:09.807673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 622/1351] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:10.643369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:10.643982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:10.650424 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:10.650891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:10.651317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:10.651992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:10.652434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:10.652872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:10.713743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:10.721591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-35382192-3b16-4be3-8965-7fb03206f175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082082 Sep 19 15:32:10.722153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 730/1352] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:10.819603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:10.821809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:10.828309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:10.828824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:10.829267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:10.829962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:10.830417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:10.830844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:10.863714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-875e88a6-984f-4bc4-a904-3c5b6b9ab124 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Sep 19 15:32:10.864305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 623/1353] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:11.744931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:11.745720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:11.752449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:11.752967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:11.753406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:11.754141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:11.754599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:11.755043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:11.819772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:11.828274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-966b0db1-5a75-41c5-bfe5-f3b7224f00e7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087575 Sep 19 15:32:11.828867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 731/1354] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:11.878430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:11.880594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:11.886979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:11.887458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:11.887887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:11.889298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:11.889747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:11.890166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:11.918354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f53cf745-f463-43e1-b7f1-1dbb636e0148 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Sep 19 15:32:11.918883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 624/1355] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:32:12.851028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:12.851637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:12.858173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:12.858643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:12.859070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:12.859741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:12.860187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:12.860626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:12.922318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:12.930046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1ef27969-3fa0-452d-abd2-6ccc5d8a0696 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082927 Sep 19 15:32:12.930603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 732/1356] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:12.931284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:12.933528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:12.940885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:12.941371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:12.941813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:12.942515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:12.942977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:12.943404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:12.972151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bb9edf4c-ccbc-495c-b1d5-a2c0f28745fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Sep 19 15:32:12.972727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 625/1357] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:13.954278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:13.954900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:13.961382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:13.961861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:13.962295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:13.962984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:13.963470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:13.963893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:13.984751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:13.986897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:13.993303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:13.994049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:13.994480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:13.995173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:13.995623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:13.996044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:14.025909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-236c6563-fc00-49c8-b85f-078d63de55a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Sep 19 15:32:14.026975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 626/1358] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:32:14.029637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:14.037676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-98d93222-70d2-4d32-aaa5-89e6cdc8fa22 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087839 Sep 19 15:32:14.038225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 733/1359] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:15.039526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:15.041622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:15.049083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:15.049620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:15.050063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:15.050763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:15.051217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:15.051638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:15.061511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:15.062974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:15.070140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:15.070616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:15.071049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:15.071746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:15.072192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:15.072680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:15.082266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-994807bf-cd7f-44c2-9cdb-732e34231716 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Sep 19 15:32:15.087068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 627/1360] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:15.145909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:15.154763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2960ad47-9b85-4b74-a94d-4a9e7316cf30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.097851 Sep 19 15:32:15.155521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 734/1361] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:16.095819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:16.100233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:16.104362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:16.104874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:16.105305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:16.105984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:16.106433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:16.106980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:16.136061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-523f3189-5d73-4c0b-b54b-de6147098bb0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Sep 19 15:32:16.136640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 628/1362] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:16.178478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:16.179123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:16.185529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:16.186009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:16.186444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:16.187135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:16.187586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:16.188010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:16.249398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:16.262080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f6efa316-e822-4573-b7e3-5a7eb574584f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087428 Sep 19 15:32:16.262644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 735/1363] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:17.150721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:17.152903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:17.159838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:17.160313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:17.160782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:17.161473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:17.161923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:17.162345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:17.191502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-990b5194-a164-4585-9c4e-45927279e72d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044882 Sep 19 15:32:17.192044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 629/1364] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:17.286065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:17.286676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:17.293097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:17.293580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:17.294013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:17.294704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:17.296119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:17.296639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:17.358466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:17.366829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6a1ae38c-136f-4f2a-9115-d4e90b6d6a12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084667 Sep 19 15:32:17.367390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 736/1365] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:18.204381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:18.206544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:18.213196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:18.213686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:18.214129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:18.214829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:18.215293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:18.215720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:18.246448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-19907317-1cf2-40bb-b3d7-207fdffe65a7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Sep 19 15:32:18.247007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 630/1366] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:18.389835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:18.390520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:18.397016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:18.397491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:18.397917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:18.398598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:18.399043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:18.399461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:18.463693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:18.471829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fddd0969-365f-4377-a018-1e6c99d11629 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085828 Sep 19 15:32:18.472405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 737/1367] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:19.259421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:19.261603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:19.269101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:19.269580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:19.270011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:19.270700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:19.271152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:19.271573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:19.301971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-950b4968-3d46-4fbc-988d-5bf27cb70447 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Sep 19 15:32:19.302530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 631/1368] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:19.494861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:19.495510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:19.502642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:19.503127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:19.503567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:19.504281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:19.504769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:19.505194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:19.567438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:19.575168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3be6d412-f235-43e2-a990-c64abf72bee5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084508 Sep 19 15:32:19.575758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 738/1369] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:20.315343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:20.317542 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:20.323900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:20.324386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:20.324862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:20.325557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:20.326015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:20.326441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:20.355914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-db4f835c-3a4a-4067-8e2e-1f3726394eff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Sep 19 15:32:20.356496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 632/1370] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:20.598626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:20.599168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:20.605538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:20.606014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:20.606447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:20.607132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:20.607581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:20.608001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:20.669748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:20.677977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-956bc873-42c6-439a-ab34-58b8f390c82f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083440 Sep 19 15:32:20.678540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 739/1371] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:21.377628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:21.379794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:21.382109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=58 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:21.386755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:21.387274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:21.387707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:21.388398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:21.388881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:21.389327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:21.420394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b39d2fdb-ef39-48cd-b52a-bdd83ed56b70 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Sep 19 15:32:21.420973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 633/1372] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:21.700941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:21.701546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:21.704204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:32:21.704342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:32:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:32:21.705432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:32:21.705556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:32:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:32:21.706324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:32:21.706441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:32:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:32:21.716423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:21.721694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:21.721694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:21.721694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:21.721694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:21.722093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:21.781104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:21.788848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-48e0156f-41b6-4451-9fb8-135656c54b5b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091734 Sep 19 15:32:21.789408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 740/1373] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:22.433062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:22.435964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:22.442605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:22.448795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:22.448795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:22.448795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:22.448795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:22.449188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:22.475518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9f08f76d-d184-46f5-8d9d-2c50501f8134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 Sep 19 15:32:22.476077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 634/1374] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:22.810914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:22.811536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:22.813872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=56 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:22.818594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:22.819080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:22.819522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:22.820242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:22.820737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:22.826036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:22.885950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:22.894371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-23671242-e565-4468-9e89-04beeb2a50fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087405 Sep 19 15:32:22.894935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 741/1375] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:23.487838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:23.490027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:23.496631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:23.497109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:23.497539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:23.498224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:23.498669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:23.499088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:23.529210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-85a3eaaa-9f8e-4166-afb7-5e3bb041ee84 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Sep 19 15:32:23.529767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 635/1376] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:23.917765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:23.918381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:23.925474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:23.925951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:23.926387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:23.927078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:23.927533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:23.927956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:23.990780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:23.998737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6c4994b9-2210-43bf-8b9f-2c83b80e6f4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084903 Sep 19 15:32:23.999305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 742/1377] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:24.541899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:24.544053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:24.546430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:32:24.546576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments (ip 10.222.0.75) !!! Sep 19 15:32:24.547617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:32:24.547765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments (ip 10.222.0.75) !!! Sep 19 15:32:24.556234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:24.556747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:24.557185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:24.557891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:24.558346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:24.558776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:24.563983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:24.590051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d835c90d-4785-46b3-91eb-07e5a64f6c94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052082 Sep 19 15:32:24.590609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 636/1378] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:32:25.021752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:25.022366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:25.028904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:25.029329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:25.029766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:25.030458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:25.030912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:25.031337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:25.092015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:25.099882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4a53f75e-dd5c-4387-b476-664ac185ee01 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082069 Sep 19 15:32:25.100441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 743/1379] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:25.603270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:25.605491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:25.612400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:25.612924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:25.613365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:25.614083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:25.614534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:25.614967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:25.644655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dfc8cab4-f770-4aef-a260-b091bcbb11e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Sep 19 15:32:25.645212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 637/1380] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:26.123338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:26.123955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:26.131153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.135519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.135519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:26.135519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.135519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.135943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:26.137746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:26.199278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:26.208623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-636ee7a8-2982-4589-8ed7-d4150a10a05b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089155 Sep 19 15:32:26.209420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 744/1381] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:26.657236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:26.659617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:26.666099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.666587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.667036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:26.667744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:26.668202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:26.668671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:26.700017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-87f8029c-2313-44b6-ac0a-c5d52174a334 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Sep 19 15:32:26.700587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 638/1382] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:27.236163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:27.236947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:27.244015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:27.244518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:27.244960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:27.245651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:27.246107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:27.246533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:27.310023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:27.318154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4150fc1e-9e05-485e-ab2f-3d11157b86cc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085974 Sep 19 15:32:27.318711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 745/1383] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:27.712322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:27.714495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:27.720853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:27.721326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:27.721760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:27.722446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:27.722890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:27.723306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:27.752404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a3838912-5f2c-4a8a-af91-fdcac2bd0bd7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043553 Sep 19 15:32:27.752982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 639/1384] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:28.341179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:28.341827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:28.348806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:28.349286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:28.349721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:28.350417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:28.350874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:28.351301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:28.413168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:28.420858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-58234b4d-b36d-47d8-9b5c-3ae4ca737134 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083560 Sep 19 15:32:28.421406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 746/1385] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:28.765249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:28.767365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:28.774646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:28.775129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:28.775565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:28.776319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:28.776827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:28.777311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:28.807343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e1584640-15d9-4971-9a2f-87e326007d7e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046223 Sep 19 15:32:28.807886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 640/1386] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:29.446592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:29.447161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:29.453639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:29.454122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:29.454563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:29.455260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:29.455714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:29.456138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:29.521434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:29.529137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d72e5e3d-38de-45d5-8878-4c89a6967b77 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087275 Sep 19 15:32:29.529704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 747/1387] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:29.820350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:29.822578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:29.829067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:29.829549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:29.829988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:29.830685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:29.831142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:29.831571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:29.860618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-46718fc1-551c-4a8d-a369-6e48e0ea5a38 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Sep 19 15:32:29.861170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 641/1388] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:30.551133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:30.551794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:30.559087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:30.559673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:30.560110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:30.560832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:30.561284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:30.561707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:30.623905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:30.632274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8296fce0-809e-4851-84fb-cc55b7f34a84 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084989 Sep 19 15:32:30.632868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 748/1389] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:30.873391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:30.875567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:30.882091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:30.882569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:30.882998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:30.883681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:30.884131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:30.884583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:30.913977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-73db221e-c3be-47b0-a52a-b3e9a30dc66b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Sep 19 15:32:30.914513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 642/1390] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:31.654982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:31.658480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:31.662122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.662595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.663022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.663705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.664149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.664595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.731788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:31.739633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d5819f7b-90c4-4a63-8026-1da27888fae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088683 Sep 19 15:32:31.740826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 749/1391] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:31.926970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:31.929771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:31.936125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.936641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.937077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.937764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:31.938208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:31.938628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:31.971822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7696fa56-6f90-4782-95d5-9de9e1df83d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048853 Sep 19 15:32:31.972376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 643/1392] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:32.763582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:32.764131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:32.770564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:32.771678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:32.772136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:32.772858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:32.773342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:32.773765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:32.833313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:32.841667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3f82be13-2410-452c-ab78-920094bfda12 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082193 Sep 19 15:32:32.842225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 750/1393] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:32.984818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:32.986969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:32.994078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:32.994551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:32.994980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:32.995663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:32.996108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:32.996548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:33.025518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-22eaa13c-8cf3-429b-b472-9111abc0b814 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Sep 19 15:32:33.025995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 644/1394] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:33.863633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:33.864249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:33.871082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:33.871559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:33.871994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:33.872708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:33.873156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:33.873578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:33.933999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:33.941661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-491f0dc3-5da5-4d82-9f47-0f7f617b8d1d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081938 Sep 19 15:32:33.942217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 751/1395] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:34.038626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:34.040748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:34.047058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:34.047531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:34.047960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:34.048671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:34.049122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:34.049541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:34.079056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b86e05d9-4eec-445d-93b5-a6918da51731 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Sep 19 15:32:34.079608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 645/1396] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:34.965679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:34.966298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:34.972739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:34.973225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:34.973659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:34.974540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:34.975050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:34.975479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:35.035809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:35.043543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4f43ed45-2207-40ad-a6c5-01fad7e3f7f1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081815 Sep 19 15:32:35.044106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 752/1397] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:32:35.091818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:35.094043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:35.100631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:35.101115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:35.101552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:35.102247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:35.102715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:35.103135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:35.132963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-23087357-941e-412b-a9b4-e419b96d4656 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Sep 19 15:32:35.133520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 646/1398] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:36.066146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:36.066759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:36.073139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:36.073610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:36.074040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:36.074719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:36.075179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:36.075593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:36.139255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:36.145610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:36.147967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d1b9fffa-b559-4183-b2a1-f107106aab91 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085650 Sep 19 15:32:36.148301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:36.148557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 753/1399] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:36.154382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:36.154867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:36.155310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:36.156010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:36.156465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:36.156917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:36.186109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3b370883-1ab4-431d-a222-42f93f78d325 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Sep 19 15:32:36.186659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 647/1400] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:32:37.171523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:37.172181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:37.178088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:37.179150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:37.179742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:37.180434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:37.180910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:37.181335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:37.198178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:37.200335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:37.206630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:37.207104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:37.207530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:37.208218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:37.208691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:37.209117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:37.239512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b623e616-804d-412e-a24a-ea69774d6f9d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045250 Sep 19 15:32:37.240495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 648/1401] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:32:37.243065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:37.251084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-19063dd2-06a9-4a8c-947d-3a653946b0ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083575 Sep 19 15:32:37.251630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 754/1402] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:38.253262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:38.255448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:38.262548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:38.263024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:38.263455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:38.264140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:38.264616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:38.265039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:38.273528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:38.274147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:38.280796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:38.281281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:38.281717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:38.282413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:38.282876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:38.283302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:38.294078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-57c3bc71-5887-4111-907c-1e60fb3533e4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Sep 19 15:32:38.294637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 649/1403] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:38.344449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:38.352684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e5697861-5cd6-4d38-8e4c-aa99f53877f2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082937 Sep 19 15:32:38.353344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 755/1404] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:32:39.306782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:39.309019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:39.315657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:39.316167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:39.316650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:39.317348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:39.317798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:39.318221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:39.348336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a3bfbb30-3d0e-47cd-9dfc-c93280bfb88e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Sep 19 15:32:39.348840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 650/1405] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:39.375401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:39.376020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:39.383081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:39.383560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:39.384001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:39.384729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:39.385189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:39.385614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:39.448210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:39.455964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5bd980ad-1bb4-4ee3-af66-0f16120d1efe tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084472 Sep 19 15:32:39.456546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 756/1406] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:40.361633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:40.363778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:40.371781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:40.376165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:40.376165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:40.376165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:40.376165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:40.376602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:40.404025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b809a8a4-b496-443a-ac34-1dce43d912d8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Sep 19 15:32:40.404631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 651/1407] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:40.479788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:40.480423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:40.486908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:40.487397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:40.487834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:40.488594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:40.489053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:40.489478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:40.553248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:40.561928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ea7b375-4c49-4204-97f4-aa15485ced06 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086625 Sep 19 15:32:40.562498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 757/1408] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:41.416681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:41.418821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:41.425231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:41.425708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:41.426142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:41.426825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:41.427269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:41.427685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:41.452546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:41.457087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-748944d4-f4fd-4ad4-9762-5654616b5f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Sep 19 15:32:41.457630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 652/1409] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:41.603858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:41.604490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:41.610901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:41.611389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:41.611828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:41.612552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:41.613014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:41.613441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:41.676852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:41.685958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c973fb92-de0f-4d75-a52c-4d6fd0592965 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086078 Sep 19 15:32:41.690046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 758/1410] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:42.478941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:42.481218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:42.487806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:42.488300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:42.488774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:42.489471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:42.489926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:42.490354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:42.519443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a3d401c7-82f8-468b-ad69-3492f96ae50c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Sep 19 15:32:42.519998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 653/1411] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:42.709596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:42.710212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:42.717313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:42.717787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:42.718217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:42.718897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:42.719343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:42.719761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:42.781030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:42.788746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-769948ef-c5eb-4738-928b-8912f452ccb7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083019 Sep 19 15:32:42.789303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 759/1412] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:43.533100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:43.535244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:43.542394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:43.542890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:43.543315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:43.544087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:43.544556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:43.544973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:43.575035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-06320679-e023-484b-9282-da4cf1a8fb47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046157 Sep 19 15:32:43.575570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 654/1413] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:43.811275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:43.811841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:43.818321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:43.818807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:43.819244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:43.819933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:43.820390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:43.820845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:43.881870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:43.885294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:43.889912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a2840d18-dd48-4b69-8515-aedfd1d16036 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082607 Sep 19 15:32:43.890477 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 760/1414] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:44.587613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:44.589789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:44.596180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:44.596689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:44.597122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:44.597807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:44.598254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:44.598676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:44.627908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0af761f2-60b3-4579-8f72-65856c56c734 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Sep 19 15:32:44.628449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 655/1415] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:44.913621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:44.914162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:44.921063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:44.921535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:44.921959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:44.922638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:44.923082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:44.923497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:44.991953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:45.000610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b924716-b38f-4ddd-9a8c-1703a8dfbc7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091336 Sep 19 15:32:45.001166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 761/1416] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:45.641936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:45.644752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:45.654762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:45.655248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:45.655689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:45.656393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:45.656904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:45.657339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:45.686552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b62e5587-e5b9-4d7a-b85c-e39edc8bbd3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050987 Sep 19 15:32:45.687113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 656/1417] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:46.023285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:46.023853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:46.030765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:46.031248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:46.031686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:46.032384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:46.032871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:46.033296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:46.094216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:46.102110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e6cc5c1a-818e-43d9-921a-d208538a9373 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082840 Sep 19 15:32:46.102672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 762/1418] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:46.699589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:46.701742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:46.708164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:46.708684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:46.709127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:46.709820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:46.710285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:46.710712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:46.741930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1ce81abb-005f-4a98-af95-77b5db8f7ea7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046559 Sep 19 15:32:46.742491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 657/1419] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:47.132771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:47.133404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:47.140397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:47.140899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:47.141328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:47.142007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:47.142450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:47.142865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:47.206487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:47.214818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e67226a0-a5c5-49b8-ad2a-704c69b0e911 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085366 Sep 19 15:32:47.215473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 763/1420] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:47.755065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:47.757252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:47.764643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:47.765130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:47.765570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:47.766267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:47.766724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:47.767153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:47.796153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-05823b44-a2bb-4dde-af4b-66bacdd4fc91 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Sep 19 15:32:47.796739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 658/1421] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:48.237671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:48.238283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:48.245767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:48.246240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:48.246671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:48.247358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:48.247803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:48.248220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:48.311511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:48.319069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-392c4b70-3cd8-4df5-a5fc-db75e0eac8f6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085430 Sep 19 15:32:48.319625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 764/1422] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:48.809601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:48.811839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:48.818256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:48.818738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:48.819174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:48.819869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:48.820321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:48.820777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:48.849930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8f06801a-1cd9-464f-a2f1-31c05d64302c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 Sep 19 15:32:48.850485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 659/1423] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:49.342278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:49.342956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:49.349364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:49.349844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:49.350275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:49.350963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:49.351421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:49.351844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:49.422359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:49.430092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f790f77-fa08-4940-ab0f-68317986eae8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091881 Sep 19 15:32:49.430652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 765/1424] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:49.862558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:49.864761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:49.871596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:49.872070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:49.872514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:49.873199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:49.873647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:49.874068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:49.902856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f745b988-3525-4c3e-997b-5598e60f15b0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Sep 19 15:32:49.903392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 660/1425] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:50.453872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:50.454550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:50.461026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:50.461500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:50.461931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:50.462613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:50.463056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:50.463475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:50.527828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:50.535830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f2c70784-33ea-413c-8f6c-6f7d09162f9a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085910 Sep 19 15:32:50.536397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 766/1426] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:50.915754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:50.918530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:50.925279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:50.925767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:50.926206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:50.926901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:50.927360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:50.927785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:50.957219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-21ea2429-34cc-4c7b-bd53-05cac406d7de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 Sep 19 15:32:50.957779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 661/1427] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:51.558536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:51.559061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:51.565410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:51.565886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:51.566310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:51.566989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:51.567434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:51.567856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:51.629221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:51.637830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-db0c933f-dd8e-45f0-a999-1bca402997f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083340 Sep 19 15:32:51.638388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 767/1428] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:51.970516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:51.972713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:51.974990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=58 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:51.979695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:51.980496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:51.981119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:51.981831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:51.982294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:51.982723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:52.013820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-14296dd1-1744-43ac-ac5a-c426b06abcc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047344 Sep 19 15:32:52.014373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 662/1429] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:52.661664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:52.662266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:52.669229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:52.669715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:52.670151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:52.671015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:52.671480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:52.671908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:52.732788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:52.740591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5dffb9e8-a6b7-4e5c-be8c-d3c3327b9023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082781 Sep 19 15:32:52.741090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 768/1430] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:53.027908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:53.030006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:53.036221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:53.036730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:53.037167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:53.037850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:53.038302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:53.038720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:53.067297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-563acc8d-740f-41ae-8b6d-401cecfbf837 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Sep 19 15:32:53.067830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 663/1431] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:53.763947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:53.764689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:53.767197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=56 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:53.772072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:53.772600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:53.773105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:53.773828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:53.774339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:53.774771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:53.841750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:53.849568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ba60886f-04e8-4d3b-a1ef-b90c54c1bf63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090257 Sep 19 15:32:53.850127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 769/1432] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:54.079415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:54.081599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:54.087927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:54.088409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:54.088886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:54.090402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:54.090859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:54.091286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:54.120001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-abe277bb-2add-421d-ae43-0d5ae7eee6f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Sep 19 15:32:54.120620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 664/1433] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:54.873677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:54.874291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:54.880697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:54.881181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:54.881616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:54.882308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:54.882774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:54.883229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:54.943512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:54.951838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d56f08f-092f-4155-98f4-a88a72cdfe29 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082226 Sep 19 15:32:54.952393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 770/1434] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:55.132179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:55.134349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:55.142268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:55.142751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:55.143193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:55.143955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:55.144412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:55.144863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:55.173980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5214ca1d-2af9-4975-bb87-dbce365a98d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045850 Sep 19 15:32:55.174525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 665/1435] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:55.975073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:55.975720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:55.983267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:55.983752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:55.984192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:55.984921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:55.985380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:55.985807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:56.047733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:56.055438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7d6eda14-610f-4e98-9522-11610eef9387 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084313 Sep 19 15:32:56.055997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 771/1436] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:56.186853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:56.189071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:56.195443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:56.195922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:56.196358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:56.197078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:56.197532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:56.197958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:56.227863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d01e30eb-0b6b-4e4e-bea9-b21106932cdc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045143 Sep 19 15:32:56.228408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 666/1437] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:57.078480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:57.079124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:57.085482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:57.085986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:57.086420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:57.087115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:57.087555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:57.087972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:57.150271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:57.158490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-669f1953-2989-4c99-a563-d2041f77a43f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083980 Sep 19 15:32:57.159041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 772/1438] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:57.240541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:57.242740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:57.249858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:57.250339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:57.250777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:57.251470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:57.251926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:57.252361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:57.281680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-407aeade-af56-47e4-bed2-a9c08591eeee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Sep 19 15:32:57.282237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 667/1439] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:58.181169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:58.181857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:58.188335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:58.188863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:58.189298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:58.189986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:58.190437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:58.190860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:58.255537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:58.263707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a6fb4aab-c939-40c7-83a8-3425f32c94de tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086457 Sep 19 15:32:58.264268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 773/1440] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:58.294622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:58.296861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:58.303290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:58.303763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:58.304191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:58.304943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:58.305396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:58.305815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:58.334802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5a5d3d9c-e707-4504-8f57-8b79c3932c28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Sep 19 15:32:58.335349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 668/1441] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:32:59.287489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:59.288132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:59.295079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:59.295551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:59.296057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:59.296768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:59.297309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:59.297729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:59.347400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:32:59.349608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:32:59.356724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:59.357217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:59.357657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:59.358402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:32:59.358829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:32:59.359243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:32:59.360863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:32:59.369153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c7835fd8-7a46-4282-8157-c6779107a5b1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085730 Sep 19 15:32:59.369920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 774/1442] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:32:59 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:32:59.378295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:32:59.391174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-25b0f133-7fc7-454b-8470-f79afdfd018a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Sep 19 15:32:59.391738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 669/1443] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:32:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:00.393015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:00.393652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:00.400098 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:00.402679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:00.402679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:00.402679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:00.402679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:00.403112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:00.403887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:00.406111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:00.412855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:00.413341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:00.413783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:00.414555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:00.415012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:00.415443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:00.447020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7c70caf2-5f0f-4fc0-910d-d8a74ae1341a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047600 Sep 19 15:33:00.447596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 670/1444] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:00.468276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:00.476083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d4926520-56e7-4913-bc1d-e18f6639287a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086937 Sep 19 15:33:00.476678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 775/1445] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:01.459674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:01.461909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:01.468844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:01.469327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:01.469759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:01.470454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:01.470930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:01.471348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:01.499622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:01.500246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:01.502875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b1568b52-1c36-4999-a8e0-12d678faba77 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Sep 19 15:33:01.503447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 671/1446] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:01.506960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:01.507445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:01.507883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:01.508607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:01.509086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:01.509513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:01.570266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:01.578179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cdb0f2ec-8331-4bb5-ad95-d6212c24dd24 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083158 Sep 19 15:33:01.578786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 776/1447] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:02.516334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:02.518617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:02.525160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:02.525644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:02.526080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:02.526981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:02.527458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:02.527893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:02.558657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-14ca7b45-df2a-4071-87ac-f6008b6a40dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Sep 19 15:33:02.559212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 672/1448] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:02.599957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:02.600609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:02.607039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:02.607520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:02.607963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:02.608684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:02.609141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:02.609567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:02.628251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:02.674074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:02.681834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-da8b36e0-44c1-4c23-9d5a-ae5b968d00c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085778 Sep 19 15:33:02.682391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 777/1449] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:03.571491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:03.573892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:03.580281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:03.580796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:03.581286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:03.581984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:03.582434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:03.582881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:03.614272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-45699b3b-a868-4b14-974a-41f7065b88dc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Sep 19 15:33:03.614876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 673/1450] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:03.705646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:03.706264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:03.712703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:03.713189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:03.713631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:03.715014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:03.715471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:03.715905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:03.789300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:03.797441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-72844d79-8097-4d31-b337-820fe31cdce5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.095642 Sep 19 15:33:03.798011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 778/1451] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:04.627041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:04.629280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:04.635680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:04.636176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:04.636648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:04.637338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:04.637796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:04.638224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:04.667742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6f7572b5-432c-4c68-82da-04f9356f9885 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Sep 19 15:33:04.668239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 674/1452] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:04.819906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:04.820547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:04.827157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:04.827640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:04.828078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:04.828796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:04.829252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:04.829676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:04.890291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:04.898029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b57f1d6d-e975-4bb9-abb9-53801ef18abc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082050 Sep 19 15:33:04.898595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 779/1453] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:05.680591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:05.683416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:05.690091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:05.690569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:05.691000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:05.691690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:05.692139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:05.692593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:05.725618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ac8c53b3-7a1f-499f-95b6-d97f93f217a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049200 Sep 19 15:33:05.726163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 675/1454] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:05.921975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:05.922583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:05.928999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:05.929472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:05.929903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:05.930577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:05.931073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:05.931439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:05.991771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:06.003187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0251fd7d-bccc-4771-942f-747529d4d02f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083125 Sep 19 15:33:06.003789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 780/1455] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:06.738648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:06.740838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:06.746963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:06.747440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:06.747914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:06.748628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:06.749077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:06.749499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:06.779789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-91e8d1bf-e843-4834-ab26-393a7daa4add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Sep 19 15:33:06.780353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 676/1456] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:07.025399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:07.025943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:07.032590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:07.033077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:07.033680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:07.034946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:07.035773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:07.036615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:07.102204 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:07.110187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ffdd790d-1509-4351-845c-c26ad2b63a50 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088910 Sep 19 15:33:07.110808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 781/1457] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:07.792330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:07.795586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:07.801900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:07.802372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:07.802810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:07.803495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:07.803941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:07.804359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:07.832631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e7ab23cc-e755-4c6f-a42a-f9f458d479b2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Sep 19 15:33:07.833176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 677/1458] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:08.133716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:08.134332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:08.141444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.141928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.142362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.143054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.143503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.143931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.216235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:08.224080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d315b44-cafb-4591-8be4-67c8ebe1d544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.094437 Sep 19 15:33:08.224681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 782/1459] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:08.845287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:08.847444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:08.853840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.854320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.854757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.855455 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:08.856605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:08.857029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:08.886392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3c4be442-8e7f-4119-83d2-574810bd78d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Sep 19 15:33:08.886870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 678/1460] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:09.246859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:09.247404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:09.254153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.254631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.255059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.255739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.256183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.256631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.316629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:09.324640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2cf0b74a-bf28-4f81-8b45-c7c6f0e81ed7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081678 Sep 19 15:33:09.324971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 783/1461] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:09 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:09.899110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:09.901369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:09.908769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.909251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.909764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.910465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:09.910976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:09.911396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:09.943287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6c55b66a-37d4-46ab-b494-3dd4827f516c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048305 Sep 19 15:33:09.943960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 679/1462] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:10.349161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:10.350226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:10.358112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:10.358769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:10.359297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:10.360206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:10.360864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:10.361421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:10.440305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:10.448681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-eae39f0a-41b2-46a2-882f-fe0ec085b0d9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.103452 Sep 19 15:33:10.449250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 784/1463] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:10.957168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:10.959398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:10.966532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:10.967018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:10.967459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:10.968159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:10.968666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:10.969098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:10.998731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f6642737-1ed4-43a1-b5f7-9b8b671ceab1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045572 Sep 19 15:33:10.999279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 680/1464] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:11.475714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:11.476333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:11.482890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:11.483374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:11.483815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:11.484531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:11.485025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:11.485447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:11.546303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:11.553926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c743149a-d418-446b-a11d-d35dd92588f5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082230 Sep 19 15:33:11.554480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 785/1465] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:12.011260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:12.013568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:12.019977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:12.020457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:12.020966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:12.021660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:12.022113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:12.022535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:12.052530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8b43a0a5-fb92-4f1b-9a66-d1f50f49bdc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045200 Sep 19 15:33:12.053026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 681/1466] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:12.577614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:12.578223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:12.584758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:12.585242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:12.585681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:12.586402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:12.586857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:12.587283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:12.651356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:12.659717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fa3d273c-27c1-4a94-8dd4-56ed8d49ba42 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086671 Sep 19 15:33:12.660281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 786/1467] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:13.065619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:13.067761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:13.074085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:13.074558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:13.074990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:13.075672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:13.076122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:13.077207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:13.105173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bf575498-336f-484a-a7f5-467b7077984e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Sep 19 15:33:13.105712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 682/1468] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:13.682259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:13.682901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:13.689546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:13.690026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:13.690461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:13.691146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:13.691597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:13.692022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:13.752449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:13.760292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c11a11b0-ef4f-4ed1-95bb-e04df5454773 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081997 Sep 19 15:33:13.760893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 787/1469] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:14.117698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:14.120122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:14.126521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:14.127000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:14.127453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:14.128121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:14.128610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:14.129038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:14.159708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f518aca0-1e9f-4b15-9ba8-350a953e3413 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Sep 19 15:33:14.160265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 683/1470] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:14.783001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:14.783620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:14.790102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:14.790580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:14.791014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:14.791700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:14.792153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:14.792597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:14.853664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:14.861385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0d866129-fb9b-4750-9433-92f0c6192a6a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082359 Sep 19 15:33:14.861948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 788/1471] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:15.172037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:15.174233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:15.180746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:15.181232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:15.181673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:15.182367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:15.182823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:15.183252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:15.212978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a2308e20-a0dd-4302-bc95-dd977e6775e6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Sep 19 15:33:15.213523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 684/1472] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:15.884140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:15.884782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:15.891499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:15.891981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:15.892420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:15.893141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:15.893594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:15.894025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:15.956340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:15.963935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4da47a20-f3ec-4a13-bc27-8ee302e122aa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083709 Sep 19 15:33:15.964498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 789/1473] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:16.225784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:16.227983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:16.235121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:16.235599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:16.236035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:16.236757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:16.237212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:16.237639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:16.267701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0ed1b6a0-5413-436f-971c-698437b3976b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Sep 19 15:33:16.268253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 685/1474] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:16.988086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:16.988719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:16.995322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:16.995794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:16.996220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:16.996926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:16.997376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:16.997796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:17.061400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:17.069790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0d31cd59-530e-4159-8d2f-36884583e5d6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086217 Sep 19 15:33:17.070379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 790/1475] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:17.279662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:17.281861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:17.288253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:17.288775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:17.289218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:17.289911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:17.290378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:17.290802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:17.294383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:17.320725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8e9ca3e5-44c8-423b-9908-2c2fbf4089ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 19 15:33:17.321262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 686/1476] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:18.092320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:18.092966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:18.099951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:18.100435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:18.100905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:18.101603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:18.102057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:18.102515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:18.163592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:18.171430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5709f8df-b75b-4a48-acb1-18c00135b5c2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082989 Sep 19 15:33:18.171992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 791/1477] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:18.333117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:18.335284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:18.342105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:18.342623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:18.343002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:18.343682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:18.344129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:18.344575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:18.374823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-94bcaf91-dbf8-4f90-b944-65d72ab136dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045672 Sep 19 15:33:18.375363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 687/1478] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:19.195719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:19.196334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:19.202698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:19.203175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:19.203622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:19.204291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:19.204765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:19.205187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:19.268980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:19.276772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6f579022-70da-47b8-ad41-4ec491a11ba3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084894 Sep 19 15:33:19.277340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 792/1479] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:19.387115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:19.389280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:19.396071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:19.396581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:19.397013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:19.397699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:19.398145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:19.398564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:19.427522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-da41b0ec-5f4f-48e1-8689-738c4c974027 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Sep 19 15:33:19.428061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 688/1480] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:20.298802 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:20.300084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:20.306771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:20.307257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:20.307698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:20.308389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:20.308906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:20.309329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:20.371051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:20.379089 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c563b140-5059-4520-b298-1ef4e52e280f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084225 Sep 19 15:33:20.379659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 793/1481] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:20.439949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:20.442197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:20.450438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:20.450989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:20.451432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:20.452138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:20.452633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:20.453063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:20.483498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2d11b757-fabd-41fd-a97a-9f6067fa6327 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047618 Sep 19 15:33:20.484057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 689/1482] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:21.401939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:21.402544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:21.409579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:21.410301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:21.410740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:21.411478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:21.411930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:21.412343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:21.416311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:21.479342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:21.487283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bf766f6f-a87b-4ed4-8368-ebee11027bad tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089133 Sep 19 15:33:21.487838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 794/1483] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:21.501039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:21.503367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:21.509392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:21.509878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:21.510320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:21.511012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:21.511468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:21.511895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:21.542002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e7148cb5-7116-4b72-9080-426da6a466fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049207 Sep 19 15:33:21.542759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 690/1484] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:22.509700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:22.510313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:22.516774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:22.517256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:22.517689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:22.518413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:22.518863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:22.519287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:22.555238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:22.557575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:22.564063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:22.564583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:22.565141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:22.565952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:22.566413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:22.566844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:22.582808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:22.590576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7c992f9a-1801-4d1f-b405-15078bccc73c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084752 Sep 19 15:33:22.591149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 795/1485] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:22.597464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-92f13685-1b56-488e-8d40-ca54d492f69c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Sep 19 15:33:22.598025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 691/1486] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:23.610119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:23.612322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:23.613573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:23.614331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:23.617706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=60 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:23.619502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:23.619983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:23.620411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:23.621125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:23.621349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:23.621569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:23.621833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:23.621982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:23.622275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:23.622973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:23.623432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:23.623860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:23.652556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-85d53241-2f38-4a84-8a9f-785f681b227a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046464 Sep 19 15:33:23.653131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 796/1487] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:23.688113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:23.696808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-58781aef-9b7f-4c56-b4ed-c449747d366f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087200 Sep 19 15:33:23.697384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 692/1488] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:24.665876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:24.668046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:24.670355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=56 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:24.674993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:24.675623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:24.675965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:24.676673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:24.677120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:24.682904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:24.707423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3fd797c6-f18f-4352-949e-b46d75b40563 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Sep 19 15:33:24.707971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 797/1489] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:24.719423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:24.720044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:24.727375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:24.727859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:24.728297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:24.729036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:24.729479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:24.729910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:24.791366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:24.799126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2cda9343-390b-416b-87cf-5576d33fc09f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083566 Sep 19 15:33:24.799687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 693/1490] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:25.719567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:25.721667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:25.728791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:25.729299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:25.729728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:25.730416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:25.730862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:25.731280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:25.761403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-586b78c3-f9dc-41e2-862f-e451f37ce72e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 Sep 19 15:33:25.761986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 798/1491] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:25.821794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:25.822440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:25.828866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:25.829373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:25.829808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:25.830519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:25.830955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:25.831378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:25.896440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:25.904081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cbb6cab6-936b-4be2-8322-eafacc0e4c36 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086175 Sep 19 15:33:25.904673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 694/1492] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:26.773871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:26.776086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:26.782586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:26.783061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:26.783484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:26.784172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:26.784649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:26.785060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:26.814430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62043c18-546d-437a-ba9d-db3f6e3cffc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Sep 19 15:33:26.814980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 799/1493] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:26.927495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:26.928098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:26.934459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:26.934930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:26.935356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:26.936034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:26.936505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:26.936916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:26.997743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:27.006075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3240541a-2fe6-40ed-b73c-d69605959251 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082996 Sep 19 15:33:27.006633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 695/1494] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:27.827376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:27.829580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:27.836759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:27.837243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:27.837678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:27.838380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:27.838838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:27.839263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:27.873562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f15f5640-e2d8-45ec-b712-6e6d58fff55a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050166 Sep 19 15:33:27.874140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 800/1495] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:28.029515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:28.030057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:28.036585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.037069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.037508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:28.038205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.038661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.039087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:28.099566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:28.107507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fb7b654b-0cda-422f-b3cf-7ac5ac433b38 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082006 Sep 19 15:33:28.108071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 696/1496] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:28.886038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:28.888197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:28.895153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.895633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.896067 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:28.896789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:28.897242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:28.897667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:28.927864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4f3ab519-e332-4a08-b320-797d028c29fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 Sep 19 15:33:28.928412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 801/1497] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:29.130211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:29.130822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:29.137276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:29.137758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:29.138194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:29.138885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:29.139337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:29.139766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:29.200910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:29.209230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a57b9039-6fee-4b72-bf64-bd468f02f08c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082911 Sep 19 15:33:29.209790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 697/1498] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:29.939673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:29.942538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:29.949028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:29.949498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:29.949953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:29.950635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:29.951079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:29.951492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:29.979779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-db5376f2-8594-4b78-9422-19402c5db0db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Sep 19 15:33:29.980322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 802/1499] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:30.232722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:30.233333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:30.240714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:30.241195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:30.241632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:30.242323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:30.242778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:30.243201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:30.313421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:30.321102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ca4cd5f3-454d-45af-b1c1-701dc088b502 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.092360 Sep 19 15:33:30.321664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 698/1500] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:30.992232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:30.994714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:31.001054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.001527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.001961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.002636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.003077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.004006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.033697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-42499ecf-f6e8-49e6-b41f-f6b8ae3d8738 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Sep 19 15:33:31.034167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 803/1501] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:31.344362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:31.345011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:31.351699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.352180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.352652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.353345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:31.353798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:31.354223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:31.415884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:31.423616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-db2d3ccf-eafe-4e77-8624-4af2f114efd4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083462 Sep 19 15:33:31.424171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 699/1502] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:32.046248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:32.048356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:32.054792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:32.055264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:32.055692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:32.056371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:32.056845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:32.057263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:32.086161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0b7adf3b-684d-4f5e-8173-5d1fd5763695 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Sep 19 15:33:32.086699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 804/1503] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:32.447154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:32.447758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:32.454395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:32.454870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:32.455298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:32.455996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:32.457030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:32.457458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:32.519503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:32.527335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0539ffc2-df71-4cc8-9d7d-2e4b1015a5a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084057 Sep 19 15:33:32.527897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 700/1504] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:33.099125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:33.101316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:33.107942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:33.108415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:33.108880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:33.109562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:33.110009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:33.110428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:33.139929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e96334a5-d502-4178-974d-2267c7d7fa79 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045360 Sep 19 15:33:33.140471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 805/1505] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:33.549846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:33.550439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:33.556787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:33.557271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:33.557708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:33.558407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:33.558861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:33.559287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:33.621378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:33.629088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-507143f9-fa9c-4b1a-9c04-1231f94fd1b7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083210 Sep 19 15:33:33.629648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 701/1506] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:34.152384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:34.154617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:34.161478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:34.161962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:34.162393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:34.163110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:34.163559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:34.163977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:34.194097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3980ea95-ffb2-4069-9de1-dca77c22cbd4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045708 Sep 19 15:33:34.194643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 806/1507] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:34.651484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:34.652101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:34.658536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:34.659019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:34.659978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:34.660937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:34.661403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:34.661834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:34.724913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:34.728257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:34.732797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ed80db23-f766-4de8-8880-22bbacf6351f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085227 Sep 19 15:33:34.737070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 702/1508] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:35.207122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:35.209318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:35.215680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:35.216094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:35.216608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:35.217290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:35.217735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:35.218147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:35.248762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2ea38f20-b60a-4fd7-a916-6a161b7122f8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046140 Sep 19 15:33:35.249329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 807/1509] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:35.758400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:35.759044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:35.765628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:35.766198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:35.766639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:35.767333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:35.767792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:35.768247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:35.829309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:35.837626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dc7a5b60-5e11-42c0-aa68-bab610ce6007 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083585 Sep 19 15:33:35.838193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 703/1510] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:36.261834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:36.264036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:36.271168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:36.274566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:36.274566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:36.274566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:36.274566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:36.275095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:36.309733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-66312346-7819-4fee-8e05-625350c78276 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051925 Sep 19 15:33:36.310290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 808/1511] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:36.861358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:36.861970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:36.868699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:36.869437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:36.869867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:36.870612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:36.871185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:36.871810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:36.932411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:36.939944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a99a0db4-dd08-46ef-9838-627c56c40023 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082617 Sep 19 15:33:36.940520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 704/1512] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:37.322457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:37.324635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:37.330562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:37.331027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:37.332048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:37.332769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:37.333212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:37.333627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:37.363347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4abb4cd6-7200-45f3-abbf-f68cba657b12 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Sep 19 15:33:37.363891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 809/1513] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:37.962360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:37.962973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:37.969372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:37.969853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:37.970291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:37.970979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:37.971433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:37.972567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:38.036774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:38.044468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0c3afbb7-5e2e-4e66-b508-77a58073b47a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085921 Sep 19 15:33:38.045047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 705/1514] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:38.376238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:38.378467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:38.384926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:38.385409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:38.385850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:38.386545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:38.387001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:38.387427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:38.413805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:38.418494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-47664ce3-e92f-4e96-a7ce-cee241a4717a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046284 Sep 19 15:33:38.419050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 810/1515] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:39.067613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:39.068226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:39.074630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:39.075106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:39.075537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:39.076226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:39.076708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:39.077133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:39.142148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:39.148797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6fa04a21-ad28-4eea-a66e-4f6cd2248887 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085496 Sep 19 15:33:39.149365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 706/1516] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:39.431799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:39.434055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:39.441624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:39.442104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:39.442540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:39.443228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:39.443703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:39.444126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:39.473053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2fc56e5a-36ae-44ba-a086-288fefbc60bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Sep 19 15:33:39.473603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 811/1517] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:40.171201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:40.171818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:40.178478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:40.178965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:40.179405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:40.180098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:40.180611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:40.181043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:40.241849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:40.249827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-826ddc0d-dde3-4573-b351-3fb953bc2ebc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082595 Sep 19 15:33:40.250403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 707/1518] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:40.485196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:40.487322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:40.493923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:40.494658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:40.495090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:40.495775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:40.496225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:40.496697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:40.531498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-78dfe63f-359e-4f98-afa0-c0bbf438366b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050657 Sep 19 15:33:40.532061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 812/1519] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:41.272556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:41.273176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:41.279747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:41.282526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:41.282526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:41.282526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:41.282526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:41.282926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:41.343515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:41.351857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5d641b8f-9967-4899-8e5c-401d029b61fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083412 Sep 19 15:33:41.352410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 708/1520] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:41.544595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:41.546679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:41.554669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:41.555148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:41.555580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:41.556286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:41.556750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:41.557171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:41.585945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-01628c82-2d27-4613-adf3-8ce7992d072c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Sep 19 15:33:41.586495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 813/1521] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:42.375364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:42.375980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:42.383223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:42.383710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:42.384153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:42.384889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:42.385352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:42.385779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:42.447963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:42.455822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-605f37be-d1bc-429c-bdac-69daa49cf1b6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084340 Sep 19 15:33:42.456522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 709/1522] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:42.599180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:42.601386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:42.607920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:42.608341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:42.608878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:42.609582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:42.610035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:42.610464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:42.640123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2c547cfb-2c81-4938-a176-3bbe081243be tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Sep 19 15:33:42.640710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 814/1523] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:43.478129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:43.478753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:43.485295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:43.485784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:43.486228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:43.486925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:43.487983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:43.488569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:43.552677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:43.560413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b2fd36ae-df5b-4d34-bed3-013f1d59386b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086166 Sep 19 15:33:43.561033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 710/1524] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:43.653451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:43.655597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:43.662492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:43.662962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:43.663394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:43.664073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:43.664544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:43.664969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:43.694368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ef838eb1-57eb-4731-b3ff-7ede30077e16 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044882 Sep 19 15:33:43.694914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 815/1525] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:44.584691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:44.585306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:44.591659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:44.592137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:44.592594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:44.593285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:44.593755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:44.594175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:44.655393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:44.662978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-79bfe82a-6120-49ab-bd26-0d63345de69c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083064 Sep 19 15:33:44.663535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 711/1526] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:44.707313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:44.709503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:44.715789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:44.716264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:44.716739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:44.717426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:44.717876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:44.718296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:44.747687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-334db1ea-ee72-4337-ae56-78cf7569158c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Sep 19 15:33:44.748238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 816/1527] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:45.686263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:45.686856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:45.693337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:45.693829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:45.694265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:45.694958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:45.695433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:45.695862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:45.759560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:45.760317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:45.762557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:45.767368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b682476-0f58-4fc2-8d5b-74e427fd4720 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085081 Sep 19 15:33:45.767936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 712/1528] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:45.769703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:45.770186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:45.770622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:45.771317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:45.771850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:45.772274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:45.802382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-07756b4b-6737-4330-a029-65ef939ec6a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Sep 19 15:33:45.802935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 817/1529] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:46.791322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:46.791973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:46.798363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:46.798843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:46.799278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:46.800741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:46.801334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:46.801763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:46.814684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:46.816974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:46.823224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:46.823697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:46.824127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:46.824842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:46.825290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:46.825705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:46.855535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9729e8e3-ae4c-4ea3-9494-87fa20a92d00 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Sep 19 15:33:46.856090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 818/1530] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:46.863690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:46.871725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0eff0cea-55d2-415f-a93a-319ca0531f3f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084386 Sep 19 15:33:46.872281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 713/1531] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:47.869033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:47.871453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:47.878002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:47.878992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:47.879425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:47.880117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:47.880600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:47.881023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:47.894269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:47.894875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:47.901466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:47.902067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:47.902508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:47.903208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:47.903688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:47.904141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:47.911387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-749ec057-49e9-48a4-a099-7b0201cb03e0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Sep 19 15:33:47.911956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 819/1532] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:47.967460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:47.975426 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-add39bc8-7356-4e67-a92c-ef8a9a910ab7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085050 Sep 19 15:33:47.975985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 714/1533] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:33:48.923961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:48.926262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:48.932661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:48.933141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:48.933576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:48.934262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:48.934712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:48.935133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:48.964922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-de31446c-5a55-4a2a-8b8a-4e01efed1e19 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Sep 19 15:33:48.965472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 820/1534] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:48.998833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:48.999450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:49.006396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:49.006881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:49.007319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:49.008017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:49.008514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:49.008928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:49.069907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:49.077543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-922a9efb-1d8b-4b36-a667-cdbaaf5db122 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082671 Sep 19 15:33:49.078291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 715/1535] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:49.976931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:49.979135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:49.985632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:49.986117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:49.986556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:49.987830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:49.988297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:49.988744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:50.024106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bfb6c654-ddf4-49d9-84cb-425b1c6d212b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051048 Sep 19 15:33:50.025013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 821/1536] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:33:50.101437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:50.102048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:50.108395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:50.108900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:50.109331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:50.110014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:50.110462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:50.110882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:50.171939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:50.180151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-089e8f8e-94ea-4050-af94-c70f2e25aaec tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082521 Sep 19 15:33:50.180741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 716/1537] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:50 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:51.037772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:51.039943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:51.046554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:51.047024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:51.047454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:51.048130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:51.048609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:51.049026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:51.078938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7bfa91c0-4503-471c-89a1-d5034e019cca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Sep 19 15:33:51.079495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 822/1538] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:51.203433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:51.204088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:51.210663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:51.211431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:51.211867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:51.212584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:51.213036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:51.213461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:51.274660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:51.282493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d32ec31e-a7d8-4fd6-8d0f-0908178ebcf0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083066 Sep 19 15:33:51.283082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 717/1539] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:52.091780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:52.093981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:52.100429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:52.100942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:52.101382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:52.102078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:52.102531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:52.102954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:52.133292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ce9fb80e-ad4e-4bc6-b0d0-069b457d57e9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045592 Sep 19 15:33:52.133851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 823/1540] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:52.305670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:52.306310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:52.312762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:52.313245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:52.313678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:52.314373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:52.314821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:52.315246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:52.381592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:52.389720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a3e49045-ba77-4437-a777-28e6e505b969 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087926 Sep 19 15:33:52.390290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 718/1541] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:53.145679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:53.147827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:53.154224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:53.154705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:53.155135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:53.155813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:53.156258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:53.156710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:53.186407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f8e5a60f-eb6f-4418-a291-52db59fdc003 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Sep 19 15:33:53.186960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 824/1542] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:53.413406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:53.413928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:53.420417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:53.420926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:53.421361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:53.422050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:53.422497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:53.422918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:53.441014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:53.485408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:53.493959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3411aba9-84ef-4a6a-bb0b-726d2cf2148a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084945 Sep 19 15:33:53.494778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 719/1543] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:54.198685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:54.200923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:54.208078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:54.208586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:54.209028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:54.209719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:54.210175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:54.210599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:54.239902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8d878d4e-0c73-4a80-9348-bb7ab7e8be13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Sep 19 15:33:54.240450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 825/1544] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:54.516587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:54.517263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:54.519623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=56 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:54.524283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:54.524795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:54.525249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:54.525934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:54.526379 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:54.526796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:54.588712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:54.596338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f435f8e5-37a3-4059-a1cd-73c669e6b90e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083683 Sep 19 15:33:54.596935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 720/1545] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:55.252625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:55.255149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:55.257545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=58 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:55.262328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:55.262802 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:55.263232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:55.263981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:55.264430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:55.271404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:55.296108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cf3a7bee-b59c-4ad4-be50-f67e52212321 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047473 Sep 19 15:33:55.296700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 826/1546] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:55.622859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:55.623503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:55.630421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:55.630919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:55.631355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:55.632045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:55.632521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:55.632948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:55.694659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:55.702684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-eaab9281-6238-4de1-9add-157c9277c0f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084473 Sep 19 15:33:55.703248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 721/1547] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:56.307933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:56.310102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:56.316859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:56.318140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:56.318140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:56.318399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:56.318849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:56.319266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:56.335360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:33:56.348712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3d025b79-4006-46eb-b3a6-24faf127d877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Sep 19 15:33:56.349273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 827/1548] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:56.726865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:56.727486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:56.733933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:56.734422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:56.734858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:56.735556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:56.736031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:56.736430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:56.804938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:56.811140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-24e38db2-7a36-4783-9cd5-f4027e0cbab4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088780 Sep 19 15:33:56.811699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 722/1549] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:57.361569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:57.364617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:57.371358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:57.371835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:57.372265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:57.372972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:57.373418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:57.373835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:57.402551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-893ecf96-0dc5-4d11-80fc-f7c71b850aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Sep 19 15:33:57.403093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 828/1550] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:57.833845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:57.834488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:57.840883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:57.841366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:57.841805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:57.842499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:57.842956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:57.843390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:57.909656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:57.916272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c3d21925-a393-46ab-89a7-00f9fb16db0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086337 Sep 19 15:33:57.916880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 723/1551] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:58.415727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:58.417940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:58.424261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:58.424771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:58.425202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:58.425915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:58.426361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:58.426786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:58.456061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f89dc2f4-6eba-4254-b9de-49ccb0ff99b6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Sep 19 15:33:58.456641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 829/1552] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:33:58.942667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:58.943452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:58.949931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:58.950416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:58.950859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:58.951560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:58.952015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:58.952442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:59.014496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:33:59.022247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b91661ae-109b-4055-b97f-f8b94dda03a6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084101 Sep 19 15:33:59.022807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 724/1553] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:33:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:33:59.469425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:33:59.471681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:33:59.478711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:59.479251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:59.479689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:59.480384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:33:59.480871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:33:59.481301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:33:59.517718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9211c444-4fe2-496a-a66b-5f84a8f50457 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Sep 19 15:33:59.517718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 830/1554] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:33:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:00.044907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:00.045472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:00.051788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:00.052259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:00.052722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:00.053413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:00.053859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:00.054278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:00.115831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:00.123700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e0f614f-78ec-4c50-a173-ad2b1ff53a81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082731 Sep 19 15:34:00.124256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 725/1555] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:00.525685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:00.527887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:00.534324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:00.534804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:00.535235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:00.536058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:00.536549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:00.536975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:00.566078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6a1eb9e2-2d57-460b-b1e3-f31198f8cfc3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Sep 19 15:34:00.566632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 831/1556] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:01.147777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:01.148418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:01.154816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:01.155300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:01.155738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:01.156436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:01.156922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:01.157349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:01.221856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:01.230239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ab8e3ca3-f4a8-4b53-90ba-3c6b7996f1f0 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087026 Sep 19 15:34:01.230794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 726/1557] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:01.579360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:01.581603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:01.588909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:01.589391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:01.589829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:01.590523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:01.590977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:01.591405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:01.620813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2ba95a00-ac2a-4011-8fdd-aae9373dc1ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Sep 19 15:34:01.621359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 832/1558] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:02.252983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:02.253594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:02.259973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:02.260571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:02.261008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:02.261705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:02.262143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:02.262559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:02.323936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:02.333951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-826acede-3ede-460e-9687-a711ba0e1b6e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084810 Sep 19 15:34:02.334525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 727/1559] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:02.633304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:02.635496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:02.643457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:02.643937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:02.644378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:02.645616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:02.646114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:02.646573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:02.681054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-79c0d7e7-bcf1-427b-bce4-9a738198c558 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051711 Sep 19 15:34:02.681615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 833/1560] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:03.359152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:03.359812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:03.366808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.367292 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.367726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.368420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.368902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.369600 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.431472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:03.439411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-782f430a-cc66-4278-998e-d4287ff6fcd2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084346 Sep 19 15:34:03.439985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 728/1561] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:03.694122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:03.696245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:03.702728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.703282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.703710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.704403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:03.704875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:03.705288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:03.736235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2aa64796-5ba4-4b68-897d-199d9ecaca3c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Sep 19 15:34:03.736828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 834/1562] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:04.462158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:04.462807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:04.469269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:04.469745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:04.470180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:04.470874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:04.471321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:04.471744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:04.535175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:04.543827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-768c0346-256b-4c92-97b3-0b3e81e0f2d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085696 Sep 19 15:34:04.544397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 729/1563] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:04.749084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:04.751299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:04.757953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:04.758429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:04.758856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:04.759547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:04.759991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:04.760411 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:04.791289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e3aad0e6-aeb4-4317-b7a4-827f68d5eee1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Sep 19 15:34:04.791844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 835/1564] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:05.567677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:05.568291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:05.575946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:05.576439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:05.576914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:05.577648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:05.578103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:05.578529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:05.640633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:05.648358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7a282557-53a4-4abd-8a7e-e03388dafff6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085195 Sep 19 15:34:05.648955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 730/1565] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:05.804068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:05.806307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:05.812787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:05.813266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:05.813717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:05.814389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:05.814852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:05.815270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:05.844755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2a2a1e01-a067-4c20-876b-064d16d61a74 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 19 15:34:05.845303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 836/1566] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:06.671169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:06.671721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:06.677949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:06.678429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:06.678864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:06.679564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:06.680016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:06.680439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:06.743175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:06.751625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2edd2677-6faf-419d-b904-6c9082581e53 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084465 Sep 19 15:34:06.752586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 731/1567] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:06.857345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:06.859551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:06.865600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:06.866074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:06.866502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:06.867183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:06.867624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:06.868038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:06.897859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aeaa8644-9087-4c59-9571-afe4b83c9166 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Sep 19 15:34:06.898400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 837/1568] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:07.891173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:07.891792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:07.898249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:07.898737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:07.899175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:07.899866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:07.900322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:07.900779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:07.910410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:07.913548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:07.919925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:07.920497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:07.921034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:07.921766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:07.922218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:07.922640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:07.952370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a582e5ad-264c-42de-9a4b-bf8354e4f374 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Sep 19 15:34:07.952989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 838/1569] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:07.963296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:07.971112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7563c133-d9e6-4d8c-b23e-da9c970e76b5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.200286 Sep 19 15:34:07.971680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 732/1570] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:08.964872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:08.967063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:08.975253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:08.975253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:08.975253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:08.975667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:08.976118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:08.976584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:08.995407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:08.996039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:09.002384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:09.002856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:09.003282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:09.003965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:09.004413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:09.004863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:09.007639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bb1592e7-3af9-451d-8ad9-2777d5377ef1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Sep 19 15:34:09.008203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 839/1571] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:09.068208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:09.075939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e5c2f02f-f94d-418d-90ba-ae5cd7ec9594 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084645 Sep 19 15:34:09.076500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 733/1572] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:34:10.019788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:10.022719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:10.029464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:10.029891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:10.030327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:10.031034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:10.031489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:10.031917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:10.070606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-eff8ee3e-0a1d-4ddc-b6c7-2b1d07417901 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055089 Sep 19 15:34:10.071187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 840/1573] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:10.098708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:10.099306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:10.105979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:10.106493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:10.106923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:10.107622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:10.108133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:10.108593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:10.177865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:10.185669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ff77a44b-0bd3-4a1a-acde-8552b84dc1bc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.090985 Sep 19 15:34:10.186320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 734/1574] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:11.082818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:11.085125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:11.092704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:11.093197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:11.093660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:11.094404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:11.094860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:11.095285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:11.126612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c71d13bf-60de-43f4-9af1-015e1996ca3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048294 Sep 19 15:34:11.127168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 841/1575] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:11.212182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:11.212887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:11.220793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:11.225050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:11.225050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:11.225050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:11.225050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:11.225417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:11.285849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:11.293452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9b6a591d-c0dc-4947-bd91-eb7dc18344eb tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086220 Sep 19 15:34:11.294102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 735/1576] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:12.139477 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:12.141685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:12.148270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:12.148784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:12.149222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:12.149915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:12.150371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:12.150794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:12.180867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-11083d92-7047-4f88-bf3b-1811c4e39329 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 19 15:34:12.181419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 842/1577] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:12.316286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:12.317037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:12.323440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:12.323923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:12.324392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:12.325118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:12.325574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:12.326003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:12.329986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:12.388830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:12.400002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-59d490da-6402-4c71-b9fc-ca6cf7d60ba5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087440 Sep 19 15:34:12.400781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 736/1578] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:13.194120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:13.196281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:13.202736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:13.203218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:13.203656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:13.204354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:13.204835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:13.205263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:13.233809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-138151cc-de73-43cc-bf87-5b68f4c3d65f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Sep 19 15:34:13.234365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 843/1579] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:13.425453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:13.426667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:13.433324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:13.433811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:13.434249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:13.434952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:13.435407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:13.435835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:13.499729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:13.507735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6b7dfd81-5a1b-4a53-94e0-3a3c0d37f9f4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088570 Sep 19 15:34:13.508299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 737/1580] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:14.247211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:14.249416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:14.256588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:14.257070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:14.257508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:14.258199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:14.258655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:14.259075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:14.262741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:14.289179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-11d0eb13-74c2-4028-ba70-b54d8421ab2d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046201 Sep 19 15:34:14.289735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 844/1581] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:14.529758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:14.530276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:14.536917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:14.537395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:14.537828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:14.538514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:14.538965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:14.539385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:14.602535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:14.610281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8b69aa35-5e6f-44aa-9eed-2d3c4200cbd6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084499 Sep 19 15:34:14.610851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 738/1582] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:15.302340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:15.304521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:15.311084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:15.311563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:15.311996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:15.312712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:15.313166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:15.313586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:15.343376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aa0fef1a-8ed7-42b4-bb1f-c3764b91de49 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Sep 19 15:34:15.343925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 845/1583] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:15.634569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:15.635179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:15.641725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:15.642202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:15.642634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:15.643324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:15.643773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:15.644192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:15.706301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:15.714308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-260a1251-7b96-45ad-9db4-a08c37782c78 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083687 Sep 19 15:34:15.714998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 739/1584] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:16.356151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:16.358353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:16.365201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:16.365672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:16.366097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:16.366770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:16.367214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:16.367635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:16.397393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-078937e1-0f77-45f7-bbec-c0e31a9a3b99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Sep 19 15:34:16.397945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 846/1585] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:16.737651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:16.738221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:16.745611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:16.746087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:16.746543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:16.747233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:16.747679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:16.748100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:16.812939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:16.821469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-77ee5df7-aa83-452c-a91e-c9af8afe187f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087728 Sep 19 15:34:16.822070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 740/1586] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:34:17.409948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:17.412274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:17.418813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:17.419293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:17.419732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:17.420426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:17.420909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:17.421334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:17.450885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6287fbc9-f4cc-42df-9db7-be0f3ca0fcdf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044954 Sep 19 15:34:17.451430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 847/1587] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:17.844472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:17.845152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:17.853893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:17.854777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:17.855442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:17.856157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:17.856655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:17.857080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:17.927940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:17.935726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-93498595-14d5-4469-9d25-8807573247ae tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.095474 Sep 19 15:34:17.936288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 741/1588] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:18.464114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:18.466318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:18.472689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:18.473914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:18.474355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:18.475044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:18.475492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:18.475913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:18.505568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2bf71189-bfb9-4de6-8512-32d889db4c35 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Sep 19 15:34:18.506128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 848/1589] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:18.959734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:18.960350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:18.966804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:18.967285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:18.967721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:18.968417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:18.968901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:18.969328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:19.030181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:19.038009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d115359d-4f0f-4da2-9be1-b6b724987b35 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082892 Sep 19 15:34:19.038561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 742/1590] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:19.518337 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:19.520572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:19.527026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:19.527503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:19.527941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:19.528679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:19.529160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:19.529587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:19.564132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3493cacb-17a2-4069-b5c7-b09dd61e1072 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049887 Sep 19 15:34:19.564731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 849/1591] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:20.060668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:20.061212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:20.067631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:20.068115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:20.068587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:20.069289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:20.069756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:20.070183 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:20.131876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:20.139511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-15410f25-f395-42f5-acde-176ec0c8695d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082881 Sep 19 15:34:20.140077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 743/1592] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:20 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:20.576455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:20.578703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:20.585960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:20.586468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:20.586936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:20.587630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:20.588112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:20.588565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:20.617881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6cec1afc-9876-4096-aa88-a53160f2a77e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Sep 19 15:34:20.618369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 850/1593] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:21.163461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:21.164106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:21.171602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:21.172093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:21.172564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:21.173268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:21.173728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:21.174153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:21.239729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:21.247882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fda46aa3-cb74-4d6c-a91e-96be7eae3e90 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.089125 Sep 19 15:34:21.248448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 744/1594] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:21.630596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:21.633369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:21.639716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:21.640197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:21.640672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:21.641369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:21.641821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:21.642245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:21.672295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f1fc33c4-bc2c-4a3b-bd0a-b69073a03480 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Sep 19 15:34:21.672880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 851/1595] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:22.270444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:22.271304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:22.277678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:22.278175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:22.278606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:22.279302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:22.279757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:22.280186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:22.342646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:22.350458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1018f5c3-8988-4e7f-9297-8573afc5bd82 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083934 Sep 19 15:34:22.351030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 745/1596] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:22.684999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:22.687208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:22.694056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:22.694536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:22.694966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:22.695650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:22.696100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:22.696520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:22.725442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d80df0d3-665e-40e3-a060-700c5cf57113 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Sep 19 15:34:22.725985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 852/1597] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:23.373458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:23.374070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:23.381026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:23.381502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:23.381935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:23.382621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:23.383071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:23.383494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:23.452362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:23.460910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-224429de-2630-48f8-b475-26cfc5e87788 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091559 Sep 19 15:34:23.461481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 746/1598] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:23.737670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:23.740372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:23.747142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:23.747617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:23.748050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:23.748812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:23.749350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:23.749798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:23.780682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-16dd1e3c-7bdf-404f-af43-3740ac73ad3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Sep 19 15:34:23.781257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 853/1599] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:24.483469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:24.484078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:24.490616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.491096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.491523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.492213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.492693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.493113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.555976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:24.563811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fc906369-aa47-4bc3-830c-4c9543615208 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084291 Sep 19 15:34:24.564375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 747/1600] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:24.792990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:24.795152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:24.801496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.802095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.802620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.803304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:24.803750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:24.804169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:24.834591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ad11e21-1502-48f1-8460-b8a6c0364abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Sep 19 15:34:24.835149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 854/1601] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:25.586715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:25.587334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:25.593759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.594243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.594684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.595383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.595872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.596302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.657923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:25.666187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3c53091c-033b-4ef0-ad4e-51b6a1f55368 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083516 Sep 19 15:34:25.666748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 748/1602] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:25.846654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:25.849478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:25.855791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.856263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.856727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.857408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:25.857852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:25.858270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:25.887227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8c38f2b7-56c3-4430-84a1-12938a12f6ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Sep 19 15:34:25.887766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 855/1603] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:26.689546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:26.690094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:26.692917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=58 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:26.697531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:26.698005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:26.698432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:26.699119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:26.699569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:26.699989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:26.764837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:26.773288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3c17a66a-589c-4255-a890-692b6324b7d7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087691 Sep 19 15:34:26.774176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 749/1604] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:26.900262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:26.902483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:26.904985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=60 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:26.909857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:26.910357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:26.910791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:26.911556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:26.912051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:26.912499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:26.943902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d941bcec-3a43-4759-b815-87777f0f7da4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Sep 19 15:34:26.944417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 856/1605] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:27.795771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:27.796378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:27.802911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.803385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.803815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.804513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.804971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.805390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.866111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:27.874032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e8aab415-c76a-4901-9e7d-c1b4f785c5bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082185 Sep 19 15:34:27.874583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 750/1606] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:27.956394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:27.959238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:27.966073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.966548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.966981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.967668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:27.968117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:27.968565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:27.998043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d29ee81b-9129-4438-9ee2-cd7f285135bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Sep 19 15:34:27.998596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 857/1607] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:28.897821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:28.898433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:28.904899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:28.905387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:28.905819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:28.906515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:28.906969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:28.907396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:28.969586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:28.977894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0ce94849-c3d0-4f75-858d-e316f83e8021 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084583 Sep 19 15:34:28.978454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 751/1608] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:29.009651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:29.011878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:29.018324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:29.018915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:29.019352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:29.020047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:29.021036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:29.021562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:29.051141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f666334-5c96-4a86-b313-86423c300065 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Sep 19 15:34:29.051814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 858/1609] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:30.000731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:30.001375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:30.007798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:30.008281 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:30.008759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:30.009454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:30.009911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:30.010334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:30.063589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:30.065780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:30.071227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:30.072406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:30.072954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:30.073394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:30.074080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:30.074525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:30.074776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:30.074943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:30.079513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-64ea5ffe-9bfa-4652-b19d-f5875f4128f3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082702 Sep 19 15:34:30.080086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 752/1610] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:30.105453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1c013f52-20dc-491c-ae6f-493a1aca49d9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Sep 19 15:34:30.106002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 859/1611] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:31.102760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:31.103375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:31.110047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:31.110524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:31.110957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:31.111656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:31.112109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:31.112555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:31.118358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:31.120875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:31.127330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:31.128245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:31.128398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:31.129011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:31.129466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:31.129887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:31.156583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:31.161410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3689b1f6-c90c-441d-b4e5-ad2ad05c0ee6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047612 Sep 19 15:34:31.161986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 860/1612] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:31.177227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:31.185478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-767526fa-5119-435e-8ae2-0361e3c99820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087051 Sep 19 15:34:31.186038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 753/1613] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:31 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:32.173652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:32.175827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:32.182583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:32.183050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:32.183475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:32.184151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:32.184626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:32.185042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:32.208657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:32.209274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:32.215304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-85351230-8401-4494-902e-7d24ec0c45cf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Sep 19 15:34:32.215894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 861/1614] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:32.216320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:32.216837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:32.217276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:32.217979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:32.218431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:32.218855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:32.279164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:32.286836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7bdd66d1-6748-433c-aae5-1169b491292d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082184 Sep 19 15:34:32.287396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 754/1615] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:34:33.229769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:33.232212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:33.239897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:33.240540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:33.241150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:33.242540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:33.243108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:33.243599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:33.277974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e3a6d162-3e85-4678-961c-38d2b2bda7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053504 Sep 19 15:34:33.278539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 862/1616] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:33.309082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:33.309731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:33.316135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:33.316665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:33.317106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:33.317801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:33.318263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:33.318689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:33.379085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:33.386984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b30f2999-66e2-4705-8709-3fb8c6a0be63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081743 Sep 19 15:34:33.387549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 755/1617] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:34:34.290668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:34.292871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:34.299261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:34.299746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:34.300177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:34.300892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:34.301347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:34.301873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:34.330553 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b81316c2-e986-4626-85d7-70d84c5ddbb5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Sep 19 15:34:34.331103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 863/1618] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:34.410540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:34.411158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:34.417772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:34.418259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:34.418698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:34.419391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:34.419876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:34.420308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:34.480784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:34.488469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dc7c01b5-b913-4548-904e-5a4b888a46ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081773 Sep 19 15:34:34.489060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 756/1619] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:35.344336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:35.346650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:35.353108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:35.353588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:35.354026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:35.354714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:35.355169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:35.355591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:35.385596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9b380b4b-36e6-4b03-8d25-48db91400643 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 19 15:34:35.386160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 864/1620] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:35.511223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:35.511839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:35.518285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:35.518767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:35.519206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:35.519905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:35.520359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:35.520821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:35.586566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:35.594266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-241ec4da-bb5c-4405-b3fc-1d81ac1f3175 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087711 Sep 19 15:34:35.594893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 757/1621] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:36.399113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:36.401335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:36.408358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:36.408879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:36.409313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:36.410011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:36.410470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:36.410893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:36.442171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8a11a93b-6668-4f73-86ad-cb4cbaf9bb06 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048047 Sep 19 15:34:36.442838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 865/1622] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:36.617420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:36.618032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:36.624220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:36.624744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:36.625176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:36.625867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:36.626318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:36.626741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:36.687022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:36.695252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f0c1bd78-bb4d-4ac0-b3d5-da51dab1bd8f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081914 Sep 19 15:34:36.695816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 758/1623] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:37.454795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:37.456976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:37.463433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:37.463928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:37.464346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:37.465064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:37.465533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:37.465957 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:37.497353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8c40b879-48ac-4f07-ad2b-55f3b79bb1dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046598 Sep 19 15:34:37.497901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 866/1624] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:37.718440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:37.718978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:37.725873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:37.726328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:37.726850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:37.727543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:37.728000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:37.728425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:37.790701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:37.798493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-41b8bfc6-baed-4a21-9a7d-ab79a1046aa7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084070 Sep 19 15:34:37.799049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 759/1625] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:38.510756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:38.513011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:38.519362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:38.519838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:38.520271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:38.520984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:38.521433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:38.521854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:38.551691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2fe4133a-31b2-4a83-8189-714107b1e335 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Sep 19 15:34:38.552235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 867/1626] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:38.824899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:38.825511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:38.831938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:38.832417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:38.832903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:38.833591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:38.834045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:38.834490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:38.895408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:38.903012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3469c5ec-9eef-4503-a2b9-14ed1f3bf067 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081997 Sep 19 15:34:38.903572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 760/1627] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:39.564988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:39.567193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:39.573672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:39.574151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:39.574639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:39.575317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:39.575767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:39.576189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:39.606987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-631e3da4-7ac4-444b-91b3-aa18cb991f8d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Sep 19 15:34:39.607548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 868/1628] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:39.925536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:39.926160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:39.933082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:39.933568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:39.934004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:39.934701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:39.935163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:39.935585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:39.999067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:40.007368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d2d0d269-8d65-499c-a2cf-2bd566ece8ce tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085219 Sep 19 15:34:40.007929 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 761/1629] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:40.620669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:40.622883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:40.629249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:40.629725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:40.630152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:40.630838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:40.631282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:40.631748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:40.660285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-10e5add4-26bd-4445-afc3-0a987820121c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Sep 19 15:34:40.660853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 869/1630] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:41.029943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:41.030565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:41.037007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:41.037493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:41.037980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:41.038785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:41.039244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:41.039674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:41.100123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:41.107873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-56e5cdb0-512b-4388-8841-fd29ce4bdaf7 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081846 Sep 19 15:34:41.108441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 762/1631] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:41 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:41.672262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:41.674506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:41.681390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:41.681867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:41.682299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:41.682984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:41.683434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:41.683854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:41.713243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-21a53063-48bd-4385-8636-4b148245e0f4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Sep 19 15:34:41.713785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 870/1632] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:42.131100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:42.132252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:42.138898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:42.139384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:42.139828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:42.140549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:42.141010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:42.141440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:42.202795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:42.211208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-25897c4f-a7d2-4dd4-9056-1704314ed37c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083977 Sep 19 15:34:42.211774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 763/1633] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:42.726683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:42.728891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:42.735314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:42.735793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:42.736229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:42.736949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:42.737404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:42.737826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:42.768118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4f66fb86-6f33-4044-bb59-ccdd1d6f7ab9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Sep 19 15:34:42.768721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 871/1634] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:43.233802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:43.234421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:43.241031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:43.241690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:43.242131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:43.242822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:43.243279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:43.243706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:43.306044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:43.313543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a71994ee-7e60-44a2-aac1-90203ad5c0bf tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083639 Sep 19 15:34:43.314101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 764/1635] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:43.781232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:43.783431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:43.790371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:43.790852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:43.791293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:43.791985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:43.792442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:43.792888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:43.822749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8e19d3ea-7ac4-49fb-9e68-ed225402d14a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Sep 19 15:34:43.823298 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 872/1636] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:44.335878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:44.336495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:44.342854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:44.343322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:44.343749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:44.344431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:44.344904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:44.345321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:44.408399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:44.416680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d2c246b7-780f-44be-bd3b-5de764e32d4a tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084826 Sep 19 15:34:44.417239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 765/1637] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:44.836034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:44.838299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:44.844717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:44.845203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:44.845642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:44.846332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:44.846785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:44.847207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:44.877294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a17ba67a-285c-43e0-a66b-e1c6a66f3b8a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Sep 19 15:34:44.877844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 873/1638] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:45.439898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:45.440533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:45.447816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:45.448307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:45.448773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:45.449479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:45.449931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:45.450360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:45.511489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:45.519165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-63499482-fb97-4f95-b2a2-3799d11f6874 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083190 Sep 19 15:34:45.519735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 766/1639] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:45.890748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:45.892955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:45.899538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:45.900013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:45.900442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:45.901152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:45.901600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:45.902024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:45.931557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8ad48b87-af0f-48fa-b657-eb3dd6a5b0a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Sep 19 15:34:45.932097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 874/1640] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:46.542744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:46.543387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:46.549892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:46.550375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:46.550812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:46.551510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:46.551966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:46.552394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:46.613447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:46.621431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-594a7b34-214e-435b-9084-5f5f37a71d58 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082690 Sep 19 15:34:46.621999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 767/1641] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:46.944684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:46.946827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:46.953304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:46.953777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:46.954206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:46.954911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:46.955358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:46.955795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:46.988425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7e1c93f8-95ad-45e5-a881-617c9efc60d1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048364 Sep 19 15:34:46.989011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 875/1642] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:47.645995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:47.646612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:47.653795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:47.654272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:47.654705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:47.655393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:47.655846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:47.656266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:47.716580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:47.724185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2ef3e81c-e3bb-4946-8380-b20fc64025e9 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082088 Sep 19 15:34:47.724779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 768/1643] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:47 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:48.001603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:48.003703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:48.010699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:48.011178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:48.011603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:48.012281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:48.012757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:48.013176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:48.042251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-67d36311-46b9-4e95-9dd3-047666032aa2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Sep 19 15:34:48.042803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 876/1644] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:48.748189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:48.748869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:48.755122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:48.755605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:48.756040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:48.757008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:48.757465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:48.757893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:48.775871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:48.822535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:48.830196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f0dbaf64-00ee-4df4-befe-8cc055ba179e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086193 Sep 19 15:34:48.830756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 769/1645] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:48 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:49.054830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:49.057266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:49.063660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:49.064141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:49.064599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:49.065292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:49.065743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:49.066159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:49.083378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:49.096572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ee18e732-f30f-4dc4-ab50-f91cc1b5bfc1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Sep 19 15:34:49.101698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 877/1646] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:49.852996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:49.853615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:49.860057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:49.860567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:49.861005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:49.861694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:49.862147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:49.862568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:50.111428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:50.113671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:50.121425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:50.121905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:50.122336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:50.123028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:50.123475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:50.123890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:50.155382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-500063c8-c5ab-4fba-9be0-1461b556ba99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Sep 19 15:34:50.155949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 878/1647] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:34:50.156381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:50.164921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1b0d99c8-dea7-49e1-894a-7a3e48f02544 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.315777 Sep 19 15:34:50.165475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 770/1648] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:49 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:51.167854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:51.170088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:51.176421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:51.176942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:51.177380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:51.178079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:51.179172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:51.179594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:51.187169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:51.187777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:51.194390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:51.194938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:51.195467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:51.196954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:51.197432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:51.197868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:51.214546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ee012938-96e3-48bf-bf48-259d4de26fd0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050622 Sep 19 15:34:51.217774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 879/1649] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:51.259451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:51.267425 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3b52741e-935a-416c-ab29-617d37eda313 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084144 Sep 19 15:34:51.268016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 771/1650] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:51 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:34:52.227565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:52.229823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:52.236194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:52.236727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:52.237166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:52.237860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:52.238314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:52.238737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:52.269355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2eca4faf-6f4a-4c00-9b98-f97b81300e6c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Sep 19 15:34:52.269915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 880/1651] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:52.290423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:52.291064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:52.297512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:52.297982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:52.298411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:52.299097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:52.299548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:52.299967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:52.370322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:52.370322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-36b87c0d-85dc-485a-a1ef-9c5726b6dffa tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083147 Sep 19 15:34:52.370680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 772/1652] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:52 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:53.282242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:53.284420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:53.290863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:53.291344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:53.291766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:53.292441 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:53.292923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:53.293339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:53.323044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-be29bd91-ab7a-4a03-861d-92cc379e7948 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Sep 19 15:34:53.323595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 881/1653] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:53.393362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:53.394000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:53.401133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:53.401605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:53.402034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:53.402719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:53.403168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:53.403589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:53.466062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:53.473774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-53e69ead-8010-46c0-ae58-bf045cb563a8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084241 Sep 19 15:34:53.474341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 773/1654] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:53 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:54.336048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:54.338346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:54.344821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:54.345310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:54.345747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:54.346435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:54.346888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:54.347312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:54.377228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2d6157ef-1dbf-468a-b2e6-4fce0e0c3556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045842 Sep 19 15:34:54.377777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 882/1655] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:54.497275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:54.497924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:54.504763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:54.505195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:54.505639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:54.506342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:54.506799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:54.507225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:54.569765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:54.577422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2b4eb6f-5f0a-4a7e-b66a-7c772ef40cf5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084416 Sep 19 15:34:54.577986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 774/1656] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:54 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:55.389956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:55.392158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:55.399386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:55.399870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:55.400308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:55.401035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:55.401491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:55.401918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:55.430997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-520d7a80-35f8-4042-a5d2-a6a40e763094 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Sep 19 15:34:55.431555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 883/1657] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:55.600321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:55.601047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:55.607395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:55.607876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:55.608309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:55.609033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:55.609485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:55.609908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:55.672635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:55.678944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cc09634f-4242-4fbe-bf2c-23ab5f11eb73 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082542 Sep 19 15:34:55.679509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 775/1658] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:55 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:56.442789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:56.445154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:56.451563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:56.452041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:56.452490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:56.453181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:56.453655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:56.454075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:56.483621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b65b7013-b254-4e7f-89cb-ebbedc81ba9b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Sep 19 15:34:56.484176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 884/1659] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:56.702500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:56.703027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:56.712119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:56.712641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:56.713088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:56.713794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:56.714247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:56.714669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:56.776508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:56.785655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ed52837d-5e7b-46a3-89a0-c12ffa93547f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087063 Sep 19 15:34:56.786540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 776/1660] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:56 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:57.496805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:57.498941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:57.505293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:57.505767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:57.506815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:57.507490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:57.507935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:57.508353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:57.536742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4ac7c25f-7841-46d1-b244-6fc16c0d8a7b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Sep 19 15:34:57.537279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 885/1661] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:57.809674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:57.810289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:57.812638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=56 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:57.817315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:57.817806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:57.818242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:57.819011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:57.819469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:57.819896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:57.884176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:57.891938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-da8f40b2-46c9-47f3-8b4d-cce580e4ddde tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086260 Sep 19 15:34:57.892535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 777/1662] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:57 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:58.549273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:58.551412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:58.553933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=60 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:34:58.558622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:58.559104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:58.559542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:58.560235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:58.560716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:58.561153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:58.591954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-981d90f6-9088-4607-b65b-ab7fa1de8926 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046804 Sep 19 15:34:58.592539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 886/1663] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:34:58.914986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:58.915605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:58.922109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:58.922592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:58.923034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:58.923728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:58.924186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:58.924647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:58.987521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:34:58.996146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7569b304-cc40-4119-b52f-e2cce219824e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085426 Sep 19 15:34:58.996747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 778/1664] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:34:58 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:34:59.604929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:34:59.607096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:34:59.613762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:59.614238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:59.614666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:59.615346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:34:59.615898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:34:59.616403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:34:59.645570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f71ce4ad-6213-406c-8339-c88f01945a2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Sep 19 15:34:59.646119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 887/1665] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:34:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:00.019360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:00.020005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:00.027227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.027709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.028153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.028938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.029343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.029777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.090742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:00.098437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e23a1b44-026a-4055-aa58-443945f49bd3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083116 Sep 19 15:35:00.099006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 779/1666] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:00 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:00.657862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:00.660004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:00.667134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.667617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.668056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.668778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:00.669231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:00.669654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:00.702549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d4439dff-0892-440b-a5fd-4a3e0c8de601 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048755 Sep 19 15:35:00.703123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 888/1667] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:01.120985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:01.121626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:01.127939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:01.128416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:01.128886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.129578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:01.130090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:01.130512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.191005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:01.198794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-81e44639-2ee4-4632-b41f-b5b8724b6e37 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081944 Sep 19 15:35:01.199355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 780/1668] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:01 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:01.715696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:01.717903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:01.724275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:01.724798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:01.725244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.725935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:01.726391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:01.726819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:01.758264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9c90e2f4-cd68-42c6-abe9-d4f76abd3136 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Sep 19 15:35:01.758835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 889/1669] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:02.222022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:02.222642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:02.229690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:02.230175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:02.230614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:02.231311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:02.231768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:02.232195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:02.292998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:02.300636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e56d5619-b025-4754-8db3-39982dc6dc5e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082484 Sep 19 15:35:02.301188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 781/1670] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:02 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:02.770969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:02.773782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:02.780341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:02.780853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:02.781293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:02.781988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:02.782444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:02.782866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:02.813577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dd8e4df3-a1dd-455e-b1e8-92bb65d84edf tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Sep 19 15:35:02.814135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 890/1671] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:03.324004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:03.324633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:03.331010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:03.331484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:03.331911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:03.332623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:03.333070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:03.333488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:03.396224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:03.404081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c11aba4b-ab96-47c7-9498-d705409ea3e2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083888 Sep 19 15:35:03.404680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 782/1672] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:03 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:03.826207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:03.828413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:03.834952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:03.835431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:03.835867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:03.836598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:03.837056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:03.837480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:03.869158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8f8d0c14-a2f8-4002-941b-1a80ef1ba4fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Sep 19 15:35:03.869988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 891/1673] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:04.427408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:04.429265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:04.436508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:04.436999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:04.437436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:04.438148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:04.438608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:04.439032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:04.518205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:04.527951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8e2138ab-c55d-4afe-9e76-4dae1055d589 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.105111 Sep 19 15:35:04.528766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 783/1674] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:04 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:04.882160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:04.884556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:04.891037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:04.891524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:04.891964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:04.892700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:04.893158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:04.893583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:04.924502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3580d818-4da6-4973-bab3-ed11804296e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Sep 19 15:35:04.925066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 892/1675] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:05.551164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:05.551787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:05.558747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:05.559264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:05.559706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:05.560402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:05.560910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:05.561338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:05.622422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:05.630077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-04c54ee2-183a-482c-b1da-bad10d3de771 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082801 Sep 19 15:35:05.630645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 784/1676] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:05 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:05.936982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:05.939131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:05.945482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:05.945962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:05.946393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:05.947149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:05.947598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:05.948018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:05.978434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-797946ec-068d-42bf-a060-a913b8498b4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Sep 19 15:35:05.978985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 893/1677] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:06.653443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:06.654060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:06.659988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:06.660465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:06.660936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:06.661623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:06.662097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:06.662523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:06.725964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:06.733710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-12fbc65b-14ab-4abc-9db2-941034d270fc tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084360 Sep 19 15:35:06.734276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 785/1678] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:06 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:06.991769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:06.994158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:07.000552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:07.001030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:07.001454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:07.002162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:07.002609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:07.003026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:07.007384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:07.032760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-72911467-35b4-4f5b-bb2c-639edb52dd66 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Sep 19 15:35:07.033304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 894/1679] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:07.761755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:07.762362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:07.768742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:07.769218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:07.769647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:07.770359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:07.770806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:07.771225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:07.775864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:07.877528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:07.885579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe26cb30-8fa7-49f0-929f-4372ae69d880 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.127665 Sep 19 15:35:07.886151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 786/1680] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:07 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:08.045898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:08.048031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:08.055701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:08.056187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:08.056654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:08.057354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:08.057810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:08.058234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:08.088029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e28eed2d-ac38-4346-9b99-0e4695d148f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Sep 19 15:35:08.088598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 895/1681] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:08.908307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:08.909099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:08.916124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:08.916626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:08.917068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:08.917764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:08.918221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:08.918651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:08.981122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:08.988886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-10b6ef66-6f0b-4955-b793-6057492b0ed5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084345 Sep 19 15:35:08.989456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 787/1682] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:08 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:09.101664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:09.103879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:09.110243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:09.110724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:09.111158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:09.111863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:09.112310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:09.112756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:09.143217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5bb464b4-fac3-495d-b48c-8e17d91d3aac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046246 Sep 19 15:35:09.143784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 896/1683] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:10.012669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:10.013289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:10.019653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:10.020142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:10.020626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:10.021325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:10.022471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:10.022956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:10.084774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:10.092398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e35c1f04-bc54-476c-a4f6-6b2c3d0890ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083698 Sep 19 15:35:10.092996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 788/1684] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:10 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:10.155903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:10.158087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:10.165550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:10.166029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:10.166463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:10.167155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:10.167605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:10.168030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:10.198414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c273cf5-3c02-4b79-89a3-8ac35319bc86 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Sep 19 15:35:10.198970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 897/1685] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:11.117087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:11.117705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:11.124369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:11.124891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:11.125331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:11.126031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:11.126491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:11.126923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:11.192030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:11.200197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-50cc7335-7c96-40de-87a1-83cc94caa36f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.088170 Sep 19 15:35:11.200804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 789/1686] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:11 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:11.210953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:11.213451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:11.219917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:11.220397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:11.220870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:11.221564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:11.222071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:11.222519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:11.253808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-07bce33d-c91f-4e61-98e6-7bd9bef30518 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Sep 19 15:35:11.254365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 898/1687] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:12.224632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:12.225274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:12.231986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:12.232471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:12.232935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:12.233642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:12.234096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:12.234522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:12.266679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:12.269314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:12.276345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:12.276858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:12.277287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:12.277981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:12.278426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:12.278842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:12.307350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:12.313566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1d1203aa-7a12-4daf-adea-fd06af54f9da tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050891 Sep 19 15:35:12.314218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 899/1688] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:35:12.315893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1efd514d-b6cf-4478-adcf-5066273902c1 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.095106 Sep 19 15:35:12.316497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 790/1689] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:12 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:13.326187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:13.328354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:13.335188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:13.335755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:13.336189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:13.336909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:13.337359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:13.337774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:13.340865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:13.341488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:13.347857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:13.348340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:13.348818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:13.350088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:13.350560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:13.350988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:13.368943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2041cc16-743d-4431-8636-62d96a49bb63 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Sep 19 15:35:13.369513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 900/1690] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:13.412561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:13.420235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a42e1d24-5a55-450a-8cf3-c69873cfe698 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083255 Sep 19 15:35:13.420840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 791/1691] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:13 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:14.381990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:14.384227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:14.390992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:14.391484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:14.391920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:14.392674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:14.393132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:14.393554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:14.424203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fa2e317f-15b9-4758-a5af-bb9adc11d120 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046364 Sep 19 15:35:14.424775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 901/1692] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:14.442687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:14.443424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:14.449911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:14.450391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:14.450829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:14.451524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:14.451976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:14.452400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:14.513325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:14.520910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-49162c0d-b114-42fc-9b70-d84a0d14f733 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082022 Sep 19 15:35:14.522105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 792/1693] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:14 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:15.437447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:15.439672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:15.446414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:15.446896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:15.447331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:15.448023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:15.448504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:15.448924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:15.479208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-028f2d1e-2f72-4228-9a37-859a1bb65c31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Sep 19 15:35:15.479764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 902/1694] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:15.544201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:15.544843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:15.551181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:15.551661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:15.552096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:15.552843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:15.553293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:15.553716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:15.618331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:15.626437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-db78caed-dd20-46fc-bd1b-27085bec3e30 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086125 Sep 19 15:35:15.627004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 793/1695] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:15 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:16.492033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:16.494379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:16.501024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:16.502625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:16.502625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:16.502625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:16.503021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:16.503439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:16.532277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6f0e65bc-8e75-44ee-b8f2-8d466f64a765 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Sep 19 15:35:16.532857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 903/1696] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:16.649925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:16.650471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:16.656845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:16.657329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:16.657766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:16.658472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:16.658909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:16.659334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:16.719457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:16.727627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ac01d5b1-8a80-4d93-847b-3fa3f9fba2ed tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081874 Sep 19 15:35:16.728190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 794/1697] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:16 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:17.545510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:17.547731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:17.554816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:17.555304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:17.555740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:17.556429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:17.556914 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:17.557340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:17.586743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a399ce5-012e-4314-a0cf-a03848b47b5a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Sep 19 15:35:17.587293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 904/1698] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:17.750976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:17.751594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:17.758666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:17.759143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:17.759574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:17.760261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:17.760753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:17.761174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:17.821572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:17.829495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3f0045f2-58ba-4463-b2a0-314faba50820 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082316 Sep 19 15:35:17.830065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 795/1699] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:17 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:18.599169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:18.602183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:18.608595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:18.609081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:18.609517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:18.610206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:18.610660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:18.611085 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:18.640284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c2d31668-cddd-4b51-badc-332895897732 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Sep 19 15:35:18.640857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 905/1700] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:18.853247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:18.853785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:18.860286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:18.860797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:18.861227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:18.861911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:18.862358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:18.862775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:18.925258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:18.933123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-725bf772-0df9-4df1-a5fc-03f27af0a20f tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084502 Sep 19 15:35:18.933677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 796/1701] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:18 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:19.652933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:19.655158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:19.661592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:19.662299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:19.662944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:19.663638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:19.664094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:19.664543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:19.694601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b823b704-c2da-4def-ba14-28a2bcd631de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Sep 19 15:35:19.695146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 906/1702] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:19.954998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:19.955646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:19.962492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:19.962973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:19.963403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:19.964092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:19.964576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:19.965000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:20.028464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:20.036242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d5d62a4f-eb60-4c1c-a682-3c0e1a5c9d74 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.085107 Sep 19 15:35:20.037589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 797/1703] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:19 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:20.707158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:20.710126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:20.716523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:20.717010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:20.717448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:20.718143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:20.718627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:20.719049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:20.748290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cfcf8fff-9be8-46f5-a3b5-5bb26e773f43 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Sep 19 15:35:20.748865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 907/1704] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:21.059725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:21.060337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:21.066799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:21.067283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:21.067730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:21.069082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:21.069536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:21.069967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:21.132727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:21.140294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-45dfc427-f58d-487a-becd-171565f40a87 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084481 Sep 19 15:35:21.140892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 798/1705] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:21 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:21.760795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:21.763078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:21.769548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:21.770024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:21.770453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:21.771657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:21.772107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:21.772549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:21.803906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ff7ff043-196c-478a-a172-2263c2874f23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Sep 19 15:35:21.804863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 908/1706] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:22.165698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:22.166345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:22.172823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.173309 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.173745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:22.174445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.174902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.175329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:22.235674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:22.244122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-19783b24-df31-4af6-89c9-8300077063c3 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082838 Sep 19 15:35:22.245262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 799/1707] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:22 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:22.819455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:22.821644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:22.828331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.828872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.829300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:22.829976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:22.830424 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:22.830837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:22.862239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9953f195-22f5-407b-8721-c2f2edb30a4b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Sep 19 15:35:22.862788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 909/1708] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:23.267085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:23.267699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:23.274315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:23.274798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:23.275253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:23.275934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:23.276387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:23.276837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:23.337738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:23.345397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e0d080b4-88fd-4a65-896a-f4a276d83df5 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082221 Sep 19 15:35:23.345958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 800/1709] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:23 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:23.875365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:23.877680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:23.884275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:23.884785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:23.885214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:23.885929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:23.886374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:23.886797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:23.911828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:23.916994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-30099298-12db-4df3-87db-8a2340d9e168 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045678 Sep 19 15:35:23.917541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 910/1710] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:24.368249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:24.368934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:24.375797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.376279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.376760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.377458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.377916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.378339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.444306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:24.452165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2042219-e09f-4f0b-9a34-e13f3fa0a93d tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087985 Sep 19 15:35:24.452768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 801/1711] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:24 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:24.934604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:24.936836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:24.944171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.944656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.945095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.945794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:24.946250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:24.946671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:24.975358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5d72b248-7339-46bf-9803-c2e8eca1da6e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Sep 19 15:35:24.975908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 911/1712] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:25.475940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:25.476587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:25.483134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.483619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.484056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:25.484782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.485242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.485672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:25.547245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:25.550653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:25.555315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7ae53b39-2510-4216-ad2c-f06670d0ad81 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083952 Sep 19 15:35:25.555884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 802/1713] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:25 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:25.988079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:25.990264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:25.996941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.997408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.997831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:25.998512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:25.998954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:25.999371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:26.029814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d69555b1-5946-4408-a6e2-51db7727936d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 19 15:35:26.030313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 912/1714] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:26.578235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:26.578878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:26.585961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:26.586442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:26.587044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:26.587748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:26.588201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:26.588662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:26.652539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:26.660288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4e0de964-679d-43d2-96b0-14e17eddaeff tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086131 Sep 19 15:35:26.660884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 803/1715] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:26 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:27.042737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:27.044936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:27.051343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:27.051826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:27.052362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:27.053255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:27.053712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:27.054137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:27.082871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a9fd6c8-8543-4348-a7e1-2db219017769 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Sep 19 15:35:27.083925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 913/1716] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:27.684268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:27.684949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:27.691313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:27.691841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:27.692263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:27.693590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:27.694050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:27.694477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:27.756250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:27.764098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4b4825ec-54f0-4f25-aac3-3fca2255ffb2 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083867 Sep 19 15:35:27.764694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 804/1717] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:27 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:28.095649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:28.097860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:28.104974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:28.105459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:28.105896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:28.106590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:28.107049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:28.107475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:28.136943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-74b3a2a1-87f8-4338-ae85-8b0520a71ec6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Sep 19 15:35:28.137496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 914/1718] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:28.787196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:28.787818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:28.790142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=56 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:28.794851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:28.795337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:28.795778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:28.796501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:28.796955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:28.797382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:28.866773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:28.874904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7c569e08-45fa-453b-87b2-3dc82ade6b4e tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.092065 Sep 19 15:35:28.875501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 805/1719] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:28 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:29.149935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:29.152128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:29.158483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.158958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.159397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.160083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.160554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.160979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.194819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2ee00840-9947-4c19-9336-0c1f0305b45d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049423 Sep 19 15:35:29.195367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 915/1720] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:29.898761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:29.899374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:29.905846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.906329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.906762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.907456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:29.907905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:29.908328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:29.969533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:29.977439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ec66bb46-a73d-40a7-b34c-5c993f239bc6 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083298 Sep 19 15:35:29.978996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 806/1721] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:29 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:30.207232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:30.209666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:30.211975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=60 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:30.216713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:30.217190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:30.217624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:30.218310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:30.218756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:30.219178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:30.251232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ed0e1372-d0b8-4f1e-9045-ed90ea652d32 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047944 Sep 19 15:35:30.251783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 916/1722] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:31.000700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:31.001311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:31.007605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:31.008100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:31.008551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:31.009256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:31.009685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:31.010101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:31.072420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:31.080108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d96f36a1-9508-492b-891f-df76a3fb1c7c tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083354 Sep 19 15:35:31.080713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 807/1723] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:30 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:31.264706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:31.266874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:31.274169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:31.274657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:31.275094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:31.275785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:31.276240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:31.276710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:31.306023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9c2fae65-2a33-4c36-b70d-49c7c44ae9bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Sep 19 15:35:31.306580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 917/1724] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:32.103886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:32.104527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:32.111011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:32.111499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:32.111935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:32.112671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:32.113132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:32.113570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:32.174435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:32.182405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4333e481-85e6-4232-a17e-4c0d4dc2ed25 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082378 Sep 19 15:35:32.182977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 808/1725] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:32 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:32.318839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:32.321073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:32.327506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:32.327990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:32.328427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:32.329147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:32.329601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:32.330025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:32.360077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aef4e933-b83c-4f77-afed-4859a482f9e2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Sep 19 15:35:32.360587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 918/1726] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:33.205443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:33.206081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:33.213823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:33.214301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:33.214734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:33.215424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:33.215873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:33.216293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:33.284266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:33.292689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4da58998-2404-4326-870a-2f0f2ac2c3e4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.091071 Sep 19 15:35:33.293247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 809/1727] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:33 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:33.372755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:33.374905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:33.381719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:33.382181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:33.382605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:33.383282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:33.383727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:33.384142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:33.412993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a5bded12-b5f2-4a72-afff-47b66feadc59 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Sep 19 15:35:33.413532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 919/1728] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:34.315548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:34.316171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:34.322705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:34.323189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:34.323628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:34.324323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:34.324806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:34.325235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:34.385669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:34.393314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1ae76963-4333-476b-a8ec-5475302b4113 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081717 Sep 19 15:35:34.393882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 810/1729] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:34 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:34.424658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:34.427399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:34.433959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:34.434439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:34.434874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:34.435567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:34.436028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:34.436458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:34.466507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-233b5145-a22b-422b-9987-c3be0400985b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Sep 19 15:35:34.467065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 920/1730] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:35.417180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:35.417807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:35.424243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:35.424756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:35.425194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:35.425889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:35.426347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:35.426778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:35.479386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:35.481732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:35.487967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:35.488193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:35.488718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:35.489159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:35.489905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:35.490361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:35.490814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:35.496020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9a5dd9af-f809-4135-9d33-8d488dd5d298 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082739 Sep 19 15:35:35.496607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 811/1731] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:35 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:35.521278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ffc5f9ee-cf08-4dd7-a94f-18412af443f5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Sep 19 15:35:35.521892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 921/1732] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:35:36.518595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:36.519203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:36.525437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:36.525947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:36.526381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:36.527065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:36.527516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:36.527939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:36.533798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:36.535988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:36.542736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:36.543221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:36.543658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:36.544356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:36.544847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:36.545282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:36.576372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3f4eb2ba-bdbd-4faa-a143-6bde5c6800a3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046493 Sep 19 15:35:36.577168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 922/1733] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:35:36.594533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:36.602146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-94f9fe93-1073-45ad-af27-89c483779c3b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.087530 Sep 19 15:35:36.602711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 812/1734] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:36 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:37.588597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:37.590808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:37.597244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:37.597714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:37.598139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:37.599380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:37.599845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:37.600255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:37.625917 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:37.626528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:37.629900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ffd12db4-8c07-4eb9-8863-cb18228f2e6d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Sep 19 15:35:37.630751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 923/1735] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:35:37.633001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:37.633486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:37.633958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:37.634669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:37.635126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:37.635554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:37.699293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:37.706972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6261398b-ef3f-4b40-a997-6de22822ceca tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084977 Sep 19 15:35:37.707543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 813/1736] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:37 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:35:38.642790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:38.645096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:38.651639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:38.652121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:38.652580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:38.653267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:38.653717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:38.654139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:38.684409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5eba37c8-15bd-4ac4-ab7d-d707474014a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Sep 19 15:35:38.685003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 924/1737] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:38.730538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:38.731144 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:38.737454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:38.737931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:38.738359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:38.739042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:38.740055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:38.740503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:38.800650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:38.808904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2d98dbc3-8188-461e-be6f-948b248f4ff8 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.082173 Sep 19 15:35:38.809459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 814/1738] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:38 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:39.697645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:39.699792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:39.706123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:39.706593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:39.707019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:39.707695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:39.708182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:39.708861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:39.737621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-45490c35-f7a2-4161-bbf9-3bf394ccb82f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Sep 19 15:35:39.738168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 925/1739] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:39.831261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:39.831877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:39.838522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:39.839010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:39.839447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:39.840193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:39.840682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:39.841110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:39.902883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:39.910561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-68b8d2b4-c100-4c9c-9349-593a428d2386 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083221 Sep 19 15:35:39.911169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 815/1740] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:39 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:40.797744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:40.800077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:40.806484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:40.806966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:40.807399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:40.808104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:40.808587 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:40.809011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:40.838959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1a1da0c5-a53f-4cbb-9535-6ab1a6dcc80d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092097 Sep 19 15:35:40.839505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 926/1741] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:40.933372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:40.934006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:40.940394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:40.940897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:40.941326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:40.942014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:40.942540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:40.943130 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:41.006588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:41.014199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3245cd0a-9481-45fd-82b5-f1e954e90f63 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.084725 Sep 19 15:35:41.014757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 816/1742] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:40 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:41.851434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:41.853629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:41.859967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:41.860430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:41.860886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:41.861563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:41.862006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:41.862422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:41.878788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:41.892496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-66d59820-27e2-44d6-9118-1f37d0cd7e47 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Sep 19 15:35:41.897607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 927/1743] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:42.035936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:42.036789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:42.043249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:42.043737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:42.044243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:42.044974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:42.045434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:42.045864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:42.109550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:42.118097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d8af9f47-c8a7-4abd-abd6-e1fc9c9d32ea tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.086117 Sep 19 15:35:42.118688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 817/1744] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:42 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:42.907548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:42.909769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:42.912777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:35:42.912921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments (ip 10.222.0.75) !!! Sep 19 15:35:42.914269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:35:42.914404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments (ip 10.222.0.75) !!! Sep 19 15:35:42.916190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:35:42.916311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments (ip 10.222.0.75) !!! Sep 19 15:35:42.927880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:42.928373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:42.928840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:42.929546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:42.930000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:42.930429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:42.961383 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b40efcf7-d074-4304-bfb9-723baff32b56 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058000 Sep 19 15:35:42.961950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 928/1745] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:35:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:35:43.141611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:43.142214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:43.149297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:43.149772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:43.150202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:43.150885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:43.151331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:43.151747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:43.211725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:43.219332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-56ab2c25-6f82-49b9-a028-93bd4abc4df4 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.081611 Sep 19 15:35:43.219886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 818/1746] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:43 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:43.974505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:35:43.976759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:43.983150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:43.983629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:43.984063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:43.984864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:43.985319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:43.985741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:44.064650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fd709495-a2f2-4893-b342-3dbd2808d060 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/action" status: 200 len: 41135 microversion: 2.1 time: 0.094414 Sep 19 15:35:44.065286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 929/1747] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:35:43 2022] POST /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558/action => generated 41135 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 15:35:44.241572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:44.242179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:44.249474 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:44.249951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:44.250382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:44.251403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:44.251857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:44.252280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:44.269473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=100 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:35:44.313382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:44.321167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b13b2f49-11db-4f9c-a89e-72f6acc66787 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.083452 Sep 19 15:35:44.321681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 819/1748] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:44 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:45.345143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:45.345843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:45.352977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:45.353445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:45.353875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:45.354549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:45.354992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:45.355407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:45.462480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:45.470232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-49e69209-210b-4ad3-812e-27013a1c3f0b tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.129380 Sep 19 15:35:45.470790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 930/1749] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:45 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:46.493295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:46.493911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] [instance: 31955ace-a21d-4a42-8e97-33da4bca71f0] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:46.496739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:35:46.496881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:35:46.498131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:35:46.498293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:35:46.499518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:35:46.499680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 (ip 10.222.0.75) !!! Sep 19 15:35:46.521615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:46.522104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:46.522544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:46.523244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:46.523704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:46.524128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:46.587534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578c0a0a8f0544949a4771a651b2ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b58d25ae1df4454813a0f76db7e4435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:46.595714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8e6c71c3-74d0-4bee-b306-dc0891df9461 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0" status: 200 len: 1219 microversion: 2.1 time: 0.106703 Sep 19 15:35:46.596310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 820/1750] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:46 2022] GET /compute/v2.1/servers/31955ace-a21d-4a42-8e97-33da4bca71f0 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:46.837675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-df663566-9c4d-41e8-9fb5-5b6c84924016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] Calling method '.version_select at 0x7f41fb0a0e50>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:46.910490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-df663566-9c4d-41e8-9fb5-5b6c84924016 tempest-TestShelveInstance-1838037679 tempest-TestShelveInstance-1838037679-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1828862492" status: 202 len: 0 microversion: 2.1 time: 0.077245 Sep 19 15:35:46.911607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 931/1751] 10.222.0.75 () {58 vars in 1254 bytes} [Mon Sep 19 15:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1828862492 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:35:49.480334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:49.481091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:49.489648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:49.490661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:49.491238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:49.492725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:49.499677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:49.499677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:49.536927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:35:49.841077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c81bf25d-bd17-4104-a731-180005383f2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 204 len: 0 microversion: 2.1 time: 0.364795 Sep 19 15:35:49.841690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 821/1752] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:35:49 2022] DELETE /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:35:49.853924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:49.853924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:49.858659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:49.859193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:49.859623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:49.860322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:49.860801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:49.861254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:49.938580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-346554c6-8ff8-4b4c-ad91-e6978a76544b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] Calling method '.version_select at 0x7f41fb2eb700>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:50.038488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:50.074734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-346554c6-8ff8-4b4c-ad91-e6978a76544b tempest-TestVolumeBootPattern-58100835 tempest-TestVolumeBootPattern-58100835-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2133944848" status: 202 len: 0 microversion: 2.1 time: 0.106108 Sep 19 15:35:50.074734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 822/1753] 10.222.0.75 () {58 vars in 1263 bytes} [Mon Sep 19 15:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2133944848 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:35:50.075454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a2a6f426-ab30-4b87-ab5e-16a2dd5b4626 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.217494 Sep 19 15:35:50.075454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 932/1754] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:51.093825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:51.094563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:51.102269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:51.103021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:51.103622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:51.104679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:51.105314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:51.105899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:51.322160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:51.332729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-995e2dff-d54f-4154-b385-c2dee630d9e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.243302 Sep 19 15:35:51.334326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 823/1755] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:51 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:52.357714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:52.358350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:52.365279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:52.365686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:52.366114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:52.366808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:52.367251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:52.367857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:52.507911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:52.516447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9293e2e3-0a08-403f-943f-8a4a3d17033b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.163127 Sep 19 15:35:52.517123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 933/1756] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:52 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:53.539877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:53.540509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:53.547080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:53.547554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:53.547973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:53.548686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:53.549137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:53.549553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:53.686368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:53.695234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2f57da6-0993-4108-a543-ef4202b37b13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.159775 Sep 19 15:35:53.696533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 824/1757] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:54.719478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:54.720414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:54.728634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:54.729210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:54.729653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:54.731592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:54.732056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:54.732504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:55.078018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:55.087822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c232159-e137-4738-9e62-08c5da6020c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.372389 Sep 19 15:35:55.089059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 934/1758] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:56.115935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:56.122529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:56.123387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:56.123868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:56.124298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:56.125024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:56.125656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:56.126082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:56.264429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:56.273624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0bcb1097-33fa-44de-812e-db11b111a5b4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.162302 Sep 19 15:35:56.274184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 825/1759] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:56 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:57.297481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:57.298102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:57.315054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:57.324031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:57.324549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:57.325324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:57.325825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:57.326260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:57.491814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:57.503414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e0f33584-86eb-438b-8d1e-42edc51b72ae tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.207242 Sep 19 15:35:57.503414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 935/1760] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:57 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:58.523546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:58.524114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:58.530625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:58.531116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:58.531558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:58.532252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:58.532739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:58.533170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:58.700247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:58.711355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-28707b0d-5e45-4a13-bd60-16367c15bdf5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.191769 Sep 19 15:35:58.712629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 826/1761] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:58 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:35:59.735391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:35:59.736106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:35:59.743221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:59.744053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:59.744662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:59.745669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:35:59.746245 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:35:59.746822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:35:59.887986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:35:59.905898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9d5463d9-aaea-4219-9821-b0193d2abcf9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.174521 Sep 19 15:35:59.917782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 936/1762] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:35:59 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:00.930834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:00.931477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:00.934040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:00.938918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:00.939407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:00.939850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:00.940640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:00.941108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:00.941552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:01.078168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:01.087602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c05acbb1-5359-4ae9-aa06-fd304bb0af0f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161435 Sep 19 15:36:01.088319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 827/1763] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:02.118404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:02.119070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:02.121937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:02.129150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:02.129150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:02.129150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:02.129150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:02.130121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:02.130121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:02.276519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:02.285119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-93098137-7b53-4b86-9493-2baedccccc36 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.170609 Sep 19 15:36:02.296506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 937/1764] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:03.310274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:03.310806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:03.317882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.318531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.319100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.319807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:03.320661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:03.321097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:03.454968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:03.463535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d825b3c1-1ffb-4d00-a7bf-604145888210 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157571 Sep 19 15:36:03.464110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 828/1765] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:04.487336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:04.488159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:04.495593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:04.496175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:04.496643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:04.497335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:04.497788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:04.498210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:04.626198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:04.635077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d265a4c8-1888-4062-b6f4-a0eeae1c2678 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151646 Sep 19 15:36:04.635647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 938/1766] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:04 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:36:05.658354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:05.658977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:05.666483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:05.666969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:05.667408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:05.668114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:05.668950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:05.669380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:05.872697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:05.878422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4fa7d7f8-1b41-4520-9df5-52e34923b8aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.223942 Sep 19 15:36:05.878993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 829/1767] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:05 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:06.904066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:06.904710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:06.911150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:06.911648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:06.912669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:06.913362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:06.913813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:06.914236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:07.045764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:07.054579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-eb017ad7-1272-4e6b-aeb3-f8d4ecf9c0cb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154792 Sep 19 15:36:07.055145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 939/1768] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:06 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:08.077657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:08.078275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:08.084491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:08.084998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:08.085436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:08.086129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:08.086583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:08.087036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:08.220009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:08.229012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-067cf9f5-b66c-4386-b22b-ea9528716e3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155317 Sep 19 15:36:08.229614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 830/1769] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:36:09.252558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:09.253177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:09.260282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:09.260796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:09.261240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:09.261927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:09.262382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:09.262802 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:09.393661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:09.402003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ec957a2e-d10d-4400-8a80-17c19677f523 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153338 Sep 19 15:36:09.402564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 940/1770] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:10.426107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:10.426804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:10.434297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:10.434782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:10.435216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:10.435909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:10.436360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:10.436813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:10.564122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:10.573014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ad9ac0e1-a6d6-4846-bc5e-424cf0fbc647 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151081 Sep 19 15:36:10.573582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 831/1771] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:10 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:11.596615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:11.597233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:11.604384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:11.604907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:11.605342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:11.606036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:11.606491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:11.606916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:11.736144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:11.744824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-192a44aa-e7cf-4a46-93e6-0e673ef84526 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152098 Sep 19 15:36:11.745651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 941/1772] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:11 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:12.768798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:12.769464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:12.776619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:12.777111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:12.777543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:12.778322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:12.778684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:12.779107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:12.906416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:12.914939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c24d8ca4-d339-467a-a687-ef81643b0164 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150065 Sep 19 15:36:12.915502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 832/1773] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:13.937836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:13.938451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:13.946763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:13.947253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:13.947692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:13.948393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:13.948875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:13.949300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:13.951988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=79 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:14.347673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:14.360511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8bcd9c7f-25a9-450e-98c4-0c24c75c6e81 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.426526 Sep 19 15:36:14.362443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 942/1774] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:15.392372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:15.393034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:15.399456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:15.399940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:15.400380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:15.401109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:15.401569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:15.402000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:15.404615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:15.542663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:15.550840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dd65921b-b1f5-4b73-a939-7acb900abd91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.162323 Sep 19 15:36:15.551414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 833/1775] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:15 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:16.574276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:16.574897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:16.581427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:16.581911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:16.582350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:16.583039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:16.583499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:16.583921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:16.718286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:16.727033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c8845e1b-504d-40f5-b1cb-dcb0170989aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156701 Sep 19 15:36:16.727590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 943/1776] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:17.751169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:17.751722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:17.758431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:17.758920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:17.759359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:17.760086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:17.760568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:17.760995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:17.888816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:17.896982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a5a6bb14-7197-4775-8c81-feaecaa9e87a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149704 Sep 19 15:36:17.898140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 834/1777] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:17 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:18.920402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:18.921046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:18.927572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:18.928062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:18.929133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:18.929945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:18.930396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:18.930823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:19.062839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:19.071230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-87f86c85-af20-4684-b191-d3c416ecc344 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154740 Sep 19 15:36:19.071788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 944/1778] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:18 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:20.095256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:20.095905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:20.103525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:20.103999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:20.104429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:20.105186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:20.105631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:20.106049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:20.234736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:20.243839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b4cf5f9a-7bf9-4632-a921-6b4f1b27fb21 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152522 Sep 19 15:36:20.244400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 835/1779] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:21.268330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:21.269012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:21.275786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:21.276271 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:21.276714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:21.277454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:21.277923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:21.278338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:21.406679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:21.413872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c0803839-b731-4023-9eca-5da1dab9bc11 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149403 Sep 19 15:36:21.419554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 945/1780] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:21 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:22.438155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:22.438842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:22.446290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:22.449373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:22.449373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:22.449373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:22.449373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:22.449781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:22.582927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:22.591631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a1431192-044f-46a9-af02-15b2cff478f3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157493 Sep 19 15:36:22.592202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 836/1781] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:23.614645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:23.615263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:23.622192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:23.622678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:23.623119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:23.623815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:23.624269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:23.624746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:23.755384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:23.763725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7c0fbd79-1911-4ffc-b469-7256506e476a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152944 Sep 19 15:36:23.764296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 946/1782] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:23 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:24.787189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:24.788318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:24.794719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:24.795201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:24.795634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:24.796325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:24.796812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:24.797234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:25.077385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:25.086784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e10c48e9-2870-439c-8b47-f106e0d6c23d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.303492 Sep 19 15:36:25.087343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 837/1783] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:24 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:26.110842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:26.111461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:26.118807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:26.119289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:26.119724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:26.120710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:26.121164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:26.121590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:26.249568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:26.258153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1953b3c3-5d05-486b-ab03-97e0dc68bb14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151170 Sep 19 15:36:26.258738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 947/1784] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:26 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:27.280896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:27.281515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:27.288249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:27.288939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:27.289389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:27.290114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:27.290574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:27.291005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:27.422265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:27.431151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-77a4528a-be6a-4f7c-8ec0-6709722304d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154138 Sep 19 15:36:27.431710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 838/1785] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:27 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:28.455020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:28.455620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:28.462920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:28.463401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:28.463839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:28.464544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:28.464997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:28.465419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:28.596869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:28.605321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1b742909-a8ad-46c2-a811-6c30474b5ff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154167 Sep 19 15:36:28.605896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 948/1786] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:28 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:29.628658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:29.629204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:29.636033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:29.636546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:29.638377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:29.638377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:29.638377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:29.638679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:29.771488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:29.780293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-738844a1-d48c-4b9a-95a2-dfa29cd67af6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155628 Sep 19 15:36:29.780902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 839/1787] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:29 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:30.803951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:30.804592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:30.811706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:30.812183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:30.812655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:30.813347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:30.813795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:30.814218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:30.944348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:30.952675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b4c08d65-527f-4ee9-bcd4-ba379e9e541e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152568 Sep 19 15:36:30.953241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 949/1788] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:30 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:31.975266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:31.975924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:31.982244 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:31.982719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:31.983150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:31.983833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:31.984279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:31.984749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:32.112811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:32.122335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-880b5a59-cd23-4f1c-b913-1453e65635b1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150943 Sep 19 15:36:32.122904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 840/1789] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:31 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:33.145854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:33.146469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:33.149558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:33.154222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:33.154712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:33.155148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:33.155841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:33.156297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:33.156745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:33.287514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:33.296532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-96f39946-d6b2-4eef-87ab-000fddec55de tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154567 Sep 19 15:36:33.297077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 950/1790] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:33 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:34.319645 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:34.320257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:34.323245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=28 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:34.327807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:34.328280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:34.328746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:34.329435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:34.329880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:34.330300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:34.462090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:34.470168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-625e3e57-a55d-4155-a8da-3d45f69b305c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154448 Sep 19 15:36:34.470725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 841/1791] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:34 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:35.493192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:35.493864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:35.500502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:35.500983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:35.501422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:35.502107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:35.502558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:35.502980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:35.634625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:35.642766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-18c06469-644f-4314-9f00-136f6d807283 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153513 Sep 19 15:36:35.643365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 951/1792] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:35 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:36.667178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:36.667775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:36.673859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:36.674337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:36.674776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:36.675462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:36.675912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:36.676331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:36.810514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:36.822046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4da18d66-9bc1-4d97-b01d-598362654642 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.159403 Sep 19 15:36:36.822661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 842/1793] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:36 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:37.844161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:37.844808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:37.850749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:37.851222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:37.851655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:37.853007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:37.853459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:37.853878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:37.980026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:37.988193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fe5a18d3-1cba-4709-8c8b-c789c7fee9d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148110 Sep 19 15:36:37.988792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 952/1794] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:37 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:39.012094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:39.012779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:39.019157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:39.019640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:39.020078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:39.020837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:39.021296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:39.021726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:39.155147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:39.163307 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-17970e35-9069-45cb-bf60-cdff494b38a8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155715 Sep 19 15:36:39.163874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 843/1795] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:39 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:40.186844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:40.187457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:40.193839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:40.194316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:40.194746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:40.196050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:40.196622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:40.197040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:40.328358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:40.336628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a4796ce1-2929-4964-8e70-485ef9bd50f9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153605 Sep 19 15:36:40.337195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 953/1796] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:40 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:41.359305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:41.359918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:41.366384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:41.366867 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:41.367343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:41.368339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:41.368832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:41.369263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:41.502653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:41.511625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f0ea7de7-b466-42c2-b191-c18a0c2d1ff4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156304 Sep 19 15:36:41.512180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 844/1797] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:41 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:42.534165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:42.534778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:42.541831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:42.542304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:42.542744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:42.543443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:42.543900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:42.544322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:42.828855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:42.837597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-17677141-3854-49d2-aabe-b177e6dc54f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.307347 Sep 19 15:36:42.838189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 954/1798] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:42 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:43.861457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:43.862072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:43.869050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:43.869540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:43.869984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:43.870949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:43.871409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:43.871843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:43.997448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:44.005548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8d6643f7-e680-4465-b126-cf456129e953 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.147990 Sep 19 15:36:44.006110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 845/1799] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:43 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:45.028909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:45.029479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:45.036039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:45.036551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:45.036993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:45.037683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:45.038140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:45.038567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:45.043164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:45.169256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:45.177346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a5fe0d08-43ac-4bf9-b784-5686368363be tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152384 Sep 19 15:36:45.177898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 955/1800] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:45 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:46.201411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:46.202028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:46.208563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:46.209054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:46.209493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:46.210193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:46.210659 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:46.211586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:46.215438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:36:46.340593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:46.348748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a6a2530e-df41-47a5-93bd-af09a8ffde8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151197 Sep 19 15:36:46.349322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 846/1801] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:46 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:47.372645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:47.373207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:47.379435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:47.379905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:47.380338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:47.381041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:47.381485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:47.381900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:47.520946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:47.529696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8b677975-ebd3-4657-86db-74e5a8d2c738 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161281 Sep 19 15:36:47.530246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 956/1802] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:47 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:48.553621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:48.554240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:48.561535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:48.562021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:48.562464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:48.563163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:48.563623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:48.564054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:48.692506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:48.700719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b9204006-c907-4f5b-bb4d-4cf5127d33a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151011 Sep 19 15:36:48.701286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 847/1803] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:48 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:36:49.723158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:49.723742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:49.730835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:49.731318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:49.731753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:49.732448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:49.732927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:49.733354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:49.859609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:49.868007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-252a7561-1bec-4161-af03-da387cd77ac4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148793 Sep 19 15:36:49.868570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 957/1804] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:50.891464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:50.892075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:50.899138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:50.899612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:50.900043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:50.900758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:50.901211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:50.901634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:51.031969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:51.040154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9bd33d54-4498-49ef-bd07-b538e78bfe07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152588 Sep 19 15:36:51.040746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 848/1805] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:50 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:52.063294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:52.063908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:52.070406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:52.070889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:52.071323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:52.072014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:52.072468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:52.072920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:52.202773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:52.213660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-56848685-1b45-4716-b2d4-a7db292cbcf4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154335 Sep 19 15:36:52.214230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 958/1806] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:52 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:53.237325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:53.237941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:53.245444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:53.245944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:53.246383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:53.247101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:53.247554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:53.247982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:53.381089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:53.390126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-38eb573e-11b3-464c-bbc6-ae0ceff9d001 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156714 Sep 19 15:36:53.390698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 849/1807] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:54.415081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:54.415693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:54.422168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:54.422651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:54.423086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:54.423778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:54.424232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:54.424693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:54.558151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:54.566318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-603b3c78-5a3f-4168-9084-99dcd6f70493 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155198 Sep 19 15:36:54.566882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 959/1808] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:55.589997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:55.590623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:55.596939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:55.597419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:55.597847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:55.598536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:55.598987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:55.599412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:55.728331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:55.736577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-22b89f0f-ac60-42d1-b566-5ce6b935e24f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151107 Sep 19 15:36:55.737142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 850/1809] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:55 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:56.761461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:56.762010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:56.768466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:56.768980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:56.769424 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:56.770117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:56.770571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:56.770994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:56.908658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:56.917418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d4be4f26-e5ad-4d26-af60-15abad6a58d9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160132 Sep 19 15:36:56.917976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 960/1810] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:56 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:57.941302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:57.941920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:57.949304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:57.950270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:57.950270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:57.950957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:57.951414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:57.951846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:58.079777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:58.087958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2bd13be0-3187-403b-8f0b-32d6b5d40df4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150572 Sep 19 15:36:58.088541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 851/1811] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:57 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:36:59.111040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:36:59.111692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:36:59.118191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:59.118668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:59.119107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:59.119799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:36:59.120521 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:36:59.120952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:36:59.251423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:36:59.260242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7f325353-88cb-43fd-8244-9f319bf85107 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153068 Sep 19 15:36:59.260852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 961/1812] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:36:59 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:00.282968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:00.283583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:00.290064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:00.290544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:00.290985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:00.291679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:00.292137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:00.292601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:00.420436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:00.428563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-36d287ac-4a23-4590-82d8-f97097db25f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149458 Sep 19 15:37:00.429675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 852/1813] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:01.454080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:01.454607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:01.461008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.461478 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.461904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.462581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:01.463023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:01.463437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:01.597631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:01.606726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-56b8910d-0259-458a-9a98-de5d702961bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156543 Sep 19 15:37:01.607299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 962/1814] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:01 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:02.631852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:02.632626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:02.640374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:02.640892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:02.641330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:02.642026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:02.642478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:02.642906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:02.770297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:02.779386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3b30102b-0c13-486f-b150-c1235950e105 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151450 Sep 19 15:37:02.779956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 853/1815] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:03.802014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:03.802625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:03.806797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:03.810100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:03.810574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:03.811003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:03.811683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:03.812127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:03.812575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:03.945950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:03.954264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-08c2b159-2d94-4294-b355-023f26f3740d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156096 Sep 19 15:37:03.954834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 963/1816] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:04.979434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:04.980067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:04.982393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:04.987045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:04.987532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:04.987975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:04.988711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:04.989179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:04.989609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:05.121135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:05.129223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2b9eb80-9c1f-4a41-b692-d546973147f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154567 Sep 19 15:37:05.129792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 854/1817] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:04 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:06.153074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:06.153725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:06.160163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:06.160682 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:06.161119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:06.161815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:06.162267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:06.162691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:06.297475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:06.306530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d809b0de-6c28-420c-b328-8c2a16ec6076 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157335 Sep 19 15:37:06.307090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 964/1818] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:06 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:07.329739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:07.330358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:07.336587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:07.337079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:07.337526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:07.338223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:07.338683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:07.339114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:07.469836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:07.478657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-30e74577-dfaf-4f0c-b7ea-fb1fbc30ce17 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152839 Sep 19 15:37:07.479433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 855/1819] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:07 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:08.503898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:08.504522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:08.511182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:08.511662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:08.512093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:08.512810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:08.513260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:08.513678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:08.639803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:08.647897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-86891a18-9c42-4643-bd5e-4ccb0eb16735 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148091 Sep 19 15:37:08.648458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 965/1820] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:09.671227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:09.671839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:09.678392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:09.678877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:09.679313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:09.680012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:09.680467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:09.684534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:09.815037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:09.824200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3507a1e2-034b-44ed-8632-9901ddfae3bc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156801 Sep 19 15:37:09.824818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 856/1821] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:10.847368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:10.847994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:10.855022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:10.855511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:10.855955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:10.856702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:10.857155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:10.857581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:10.994427 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:11.004134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-94736659-0cf0-47de-8911-98e5bdae0ba6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160769 Sep 19 15:37:11.021292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 966/1822] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:10 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:12.028104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:12.028822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:12.035201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.035685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.036124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.036844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:12.037318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:12.037751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:12.176472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:12.185417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e4448949-9400-4b9f-ae50-cca36e38a5f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161229 Sep 19 15:37:12.190706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 857/1823] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:13.209458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:13.210097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:13.216635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.217111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.217547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:13.218234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:13.218679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:13.219094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:13.347329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:13.356060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9189443b-9eef-4476-a5ac-83a91c68f0d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150516 Sep 19 15:37:13.356636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 967/1824] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:14.380002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:14.380654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:14.387511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:14.388024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:14.388464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:14.389199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:14.389654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:14.390081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:14.528577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:14.536631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c0ffb47d-156a-48b0-ae47-ba700f7bfdf7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160537 Sep 19 15:37:14.537185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 858/1825] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:14 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:15.561668 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:15.562252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:15.568769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:15.569241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:15.569671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:15.570861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:15.571305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:15.571714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:15.574212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:15.703224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:15.712011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-23bbd484-d969-49b3-9c11-8ca4ecf91768 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154285 Sep 19 15:37:15.712639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 968/1826] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:15 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:16.735310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:16.735900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:16.742212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:16.742691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:16.743125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:16.743812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:16.744262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:16.744707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:16.747443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:16.878104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:16.886446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-364d456e-9a54-4dd8-a407-64f68f26e352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155062 Sep 19 15:37:16.887028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 859/1827] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:17.910057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:17.910664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:17.917792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:17.918269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:17.918836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:17.919869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:17.920581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:17.921220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:18.055890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:18.064003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c84f34f-c39b-4ab1-8f4f-a24f2b2ed981 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157791 Sep 19 15:37:18.064594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 969/1828] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:17 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:19.087198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:19.088166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:19.094637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:19.095123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:19.095561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:19.096260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:19.096761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:19.097191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:19.225844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:19.234020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-79a42ad2-0339-49a3-b679-4bf6f74f06f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150882 Sep 19 15:37:19.234582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 860/1829] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:19 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:20.257716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:20.258335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:20.265637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:20.266122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:20.266562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:20.267257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:20.267730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:20.268139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:20.394447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:20.403409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8c42c934-94af-4151-aaaa-d838ba2ffee2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149512 Sep 19 15:37:20.403969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 970/1830] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:21.426772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:21.427382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:21.434473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:21.436852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:21.436852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:21.436852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:21.436852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:21.437243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:21.564912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:21.573315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-be69d5a0-5e10-4444-ba99-864a98196ad5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150463 Sep 19 15:37:21.573884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 861/1831] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:21 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:22.595895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:22.596504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:22.603646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:22.604126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:22.604601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:22.605336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:22.605788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:22.606215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:22.737661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:22.746013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5fb2acf9-e2f7-4217-a284-d74559a630fe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153809 Sep 19 15:37:22.746566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 971/1832] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:23.768776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:23.769391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:23.776440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:23.776967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:23.777404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:23.778105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:23.778556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:23.778978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:23.909100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:23.917861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-52ffaaeb-08a8-47fb-bde2-e14967b2ebe7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153076 Sep 19 15:37:23.918423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 862/1833] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:23 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:24.940588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:24.941223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:24.949195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:24.949680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:24.950112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:24.950805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:24.951255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:24.951678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:25.085943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:25.094831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4afd95a8-a04d-43a2-9059-5ab421b7b3f4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.158180 Sep 19 15:37:25.095408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 972/1834] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:24 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:26.117469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:26.118075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:26.125029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:26.125513 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:26.125952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:26.126648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:26.127104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:26.127529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:26.254899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:26.264195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8234691b-10a2-495e-97a3-d37c3b77385b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150585 Sep 19 15:37:26.264790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 863/1835] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:26 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:27.287345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:27.287963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:27.294514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:27.294995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:27.295433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:27.296126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:27.296606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:27.297030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:27.432193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:27.440409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1ab148df-0c0a-4c5e-af9e-bcd388b8bb28 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157033 Sep 19 15:37:27.441094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 973/1836] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:27 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:28.463207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:28.463860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:28.470989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:28.471467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:28.471901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:28.472634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:28.473092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:28.473518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:28.611832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:28.620984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-23627029-69eb-4b43-8092-99351d8f203a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161377 Sep 19 15:37:28.621555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 864/1837] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:28 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:29.644378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:29.645018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:29.651558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:29.652035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:29.652470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:29.653182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:29.653631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:29.654050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:29.782746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:29.791869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f444a021-b72c-4454-b55f-deb72e2bbce5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151348 Sep 19 15:37:29.792378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 974/1838] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:29 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:30.815514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:30.816137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:30.823134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:30.823617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:30.824056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:30.824792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:30.825249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:30.825679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:30.954698 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:30.963706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-006293d6-7862-4fdd-8595-046dd6adf667 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152098 Sep 19 15:37:30.964267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 865/1839] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:30 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:31.987374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:31.988012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:31.995055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:31.995787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:31.996227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:31.996935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:31.997386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:31.997805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:32.124194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:32.132418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2c339a8d-0173-4d90-b7d6-2ca1f34925f6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149041 Sep 19 15:37:32.133000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 975/1840] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:31 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:33.161293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:33.161909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:33.169043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:33.169524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:33.169961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:33.170660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:33.171117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:33.171544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:33.300775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:33.308907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5325f59f-3f73-4c34-9437-3557fd4bcd23 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151619 Sep 19 15:37:33.309468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 866/1841] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:33 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:34.331160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:34.331780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:34.334082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:34.338849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:34.339332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:34.339768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:34.340469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:34.340944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:34.341370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:34.473450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:34.482241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-95091617-f86a-42ab-b3be-4ea02af3aafd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154949 Sep 19 15:37:34.482804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 976/1842] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:34 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:35.506780 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:35.507321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:35.509681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:35.514351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:35.514834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:35.515275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:35.516004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:35.516463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:35.516915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:35.644607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:35.653487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7209773f-e8bf-45e2-a813-5691d8b039db tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150824 Sep 19 15:37:35.654054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 867/1843] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:35 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:36.676579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:36.677197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:36.683338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:36.683821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:36.684258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:36.685005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:36.685460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:36.685885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:36.814498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:36.823711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1c2de0d4-3b74-40bb-a43f-045a09976855 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151054 Sep 19 15:37:36.824269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 977/1844] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:36 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:37.847673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:37.848276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:37.855114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:37.855591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:37.856017 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:37.856731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:37.857178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:37.857596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:37.990448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:37.999072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2e3bb7d1-0e90-4561-8b2f-9b171d8d630b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155477 Sep 19 15:37:37.999631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 868/1845] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:37 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:39.023162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:39.023906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:39.030798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:39.031234 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:39.031674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:39.032383 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:39.032875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:39.033332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:39.165737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:39.173886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5ff5de7b-87f9-4ac9-9b84-9a306178c9af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154645 Sep 19 15:37:39.174451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 978/1846] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:39 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:40.197612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:40.198217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:40.204612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:40.205094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:40.205528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:40.206217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:40.206673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:40.207092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:40.335576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:40.343887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-90351460-60fe-4372-a08d-e0a3dc046601 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150792 Sep 19 15:37:40.344446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 869/1847] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:40 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:41.367494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:41.367961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:41.374733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:41.375210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:41.375641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:41.376332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:41.376809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:41.377230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:41.507194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:41.515917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-00a4a562-6145-4684-ba5a-45af5a55d0ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152627 Sep 19 15:37:41.516466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 979/1848] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:41 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:42.538499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:42.539198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:42.546128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:42.546599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:42.547023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:42.547707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:42.548150 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:42.548601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:42.679108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:42.687673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-234c70c8-e180-4d54-8e1d-619ca249380d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153046 Sep 19 15:37:42.688225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 870/1849] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:42 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:37:43.711948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:43.712846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:43.720254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:43.720775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:43.721216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:43.721912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:43.722407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:43.722828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:43.852083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:43.864499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5c9e2ccc-84ac-4b3b-baab-24b6ae432387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157017 Sep 19 15:37:43.865086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 980/1850] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:43 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:44.887490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:44.888106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:44.894777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:44.895262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:44.895702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:44.896395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:44.896876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:44.897302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:45.027996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:45.035974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33f6ae0e-105a-4f45-b775-6c705fe85bee tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152630 Sep 19 15:37:45.036545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 871/1851] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:44 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:46.059953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:46.060563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:46.066820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:46.067291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:46.067718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:46.068391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:46.068863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:46.069281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:46.073826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:46.197351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:46.205537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b8672d8f-ca0a-41f3-bb5b-518399b53444 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149588 Sep 19 15:37:46.206111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 981/1852] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:46 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:47.229116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:47.229732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:47.236119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:47.236633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:47.237069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:47.237769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:47.238230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:47.238655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:47.242549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:37:47.366750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:47.375320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a7c7dfe4-7a81-4dd7-9691-16040f3e5989 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150176 Sep 19 15:37:47.375888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 872/1853] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:47 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:48.399685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:48.400503 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:48.407092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:48.407572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:48.408005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:48.408735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:48.409186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:48.409604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:48.538382 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:48.546728 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ffb818f2-12a5-4f7a-a637-0a819e5f1741 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151650 Sep 19 15:37:48.547282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 982/1854] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:48 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:49.570120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:49.571016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:49.577524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:49.578008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:49.578448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:49.579145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:49.579603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:49.580030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:49.708576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:49.717526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-50c19e03-e196-4c72-b801-4145e270aad1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151299 Sep 19 15:37:49.718101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 873/1855] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:50.740810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:50.741417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:50.748335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:50.748849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:50.749296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:50.749992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:50.750447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:50.750868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:50.885654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:50.890203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f7aec53b-d774-4e9c-b224-05856268597e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153389 Sep 19 15:37:50.890764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 983/1856] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:50 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:51.913818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:51.915007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:51.921473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:51.921947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:51.922375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:51.923058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:51.923503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:51.923919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:52.051059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:52.059905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-98efda49-7e0d-475c-a8c4-e0d2b270b97c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149937 Sep 19 15:37:52.060461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 874/1857] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:51 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:53.083620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:53.084231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:53.091329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:53.091811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:53.092242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:53.093435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:53.094242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:53.094677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:53.233781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:53.241906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5598c4aa-98fd-4b59-a978-2bea63dfd739 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.162317 Sep 19 15:37:53.242470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 984/1858] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:54.266266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:54.266887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:54.273277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:54.273754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:54.274190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:54.274978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:54.275415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:54.275837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:54.405241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:54.413344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dc9194cb-51e5-450a-a82f-b3b970a53bac tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151017 Sep 19 15:37:54.413907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 875/1859] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:55.436224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:55.436769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:55.443571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:55.444045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:55.444496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:55.445173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:55.445618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:55.446033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:55.572818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:55.581052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bf551964-7886-4b14-8c20-9e89d029abdf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148847 Sep 19 15:37:55.581616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 985/1860] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:55 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:56.604722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:56.605975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:56.612450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:56.612967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:56.613399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:56.614096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:56.614561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:56.614990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:56.746345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:56.754537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-74ae57c4-3093-47f3-b142-60210cd5387e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153766 Sep 19 15:37:56.755168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 876/1861] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:56 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:57.778849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:57.779545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:57.786419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:57.786904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:57.787341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:57.788033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:57.788646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:57.789101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:57.919662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:57.928112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dae2f1eb-7fd9-4228-b4c1-9a010108c64b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153645 Sep 19 15:37:57.928721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 986/1862] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:57 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:37:58.951266 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:37:58.951889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:37:58.958295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:58.958776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:58.959215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:58.959902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:37:58.960357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:37:58.960887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:37:59.089537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:37:59.097561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a0f6c0b1-6c1b-4ef8-8ba7-a8a756cb3fb9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151146 Sep 19 15:37:59.098123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 877/1863] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:37:58 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:00.121397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:00.121951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:00.128282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:00.128793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:00.129247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:00.129922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:00.130367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:00.130780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:00.263822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:00.272018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8b9e7c02-57df-4e43-b8c3-ec0986eac61b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155214 Sep 19 15:38:00.272689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 987/1864] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:01.294362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:01.294982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:01.301651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:01.302137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:01.302636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:01.303337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:01.303857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:01.304350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:01.436796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:01.445132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bf713df2-33f1-4da4-a005-8a3c3c7d2d7e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154932 Sep 19 15:38:01.445755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 878/1865] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:01 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:02.469309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:02.469935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:02.476345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:02.476860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:02.477577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:02.478270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:02.478719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:02.479141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:02.608627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:02.616892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8f64a5a2-ea71-4f10-b63b-bc6f72771c9f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151551 Sep 19 15:38:02.617455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 988/1866] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:03.641785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:03.642407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:03.648933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:03.649419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:03.649860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:03.650558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:03.651018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:03.651446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:03.778915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:03.787041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-42f47e96-b095-4c2f-9610-d11966515dc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149542 Sep 19 15:38:03.787599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 879/1867] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:04.810329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:04.810944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:04.813286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:04.817924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:04.818404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:04.818868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:04.819560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:04.820016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:04.820437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:04.953638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:04.961760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-81fce788-559c-4488-98ab-79c7d3dee5f8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155676 Sep 19 15:38:04.962320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 989/1868] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:04 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:05.985304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:05.985925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:05.988212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:05.992937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:05.993424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:05.993864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:05.994564 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:05.995021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:05.996174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:06.124432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:06.132588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ffca559a-9200-4c86-a393-020504b69431 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151168 Sep 19 15:38:06.133146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 880/1869] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:05 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:07.155954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:07.156594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:07.162533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:07.163017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:07.163456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:07.164153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:07.164633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:07.165061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:07.293652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:07.301767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f1eaf840-e77d-4c12-ad77-2a5296baafc5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150351 Sep 19 15:38:07.302328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 990/1870] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:07 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:08.601927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:08.602547 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:08.608712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:08.609199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:08.609640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:08.610342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:08.610800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:08.611224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:08.740748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:08.749894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-772be268-7c44-4b9e-9072-05adc393fcbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.427561 Sep 19 15:38:08.750464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 881/1871] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:09.780041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:09.780604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:09.786954 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:09.789844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:09.789844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:09.789844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:09.789844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:09.790328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:09.925721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:09.935241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3f0044a8-363d-4f02-8b69-a6c0515b2cef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.165021 Sep 19 15:38:09.935830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 991/1872] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:10.958907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:10.959526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:10.966521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.967005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.967440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:10.968141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:10.968627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:10.969065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:11.108332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:11.109516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1240f05f-708f-431a-947e-55d11c92d198 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154461 Sep 19 15:38:11.110087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 882/1873] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:10 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:12.131939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:12.132575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:12.138937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:12.139416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:12.139853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:12.140568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:12.141024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:12.141446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:12.271846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:12.280677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3e5b6397-64e2-4e89-b9c8-147999176039 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152617 Sep 19 15:38:12.281235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 992/1874] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:13.304218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:13.304865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:13.312486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:13.312981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:13.313420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:13.314149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:13.314599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:13.315021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:13.443061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:13.451556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d699cba0-d961-4193-a646-ee2fce009148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151245 Sep 19 15:38:13.452122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 883/1875] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:14.475241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:14.475885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:14.483004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:14.483487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:14.483922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:14.484647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:14.485097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:14.485523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:14.616224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:14.626124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d9b9b3d7-81cd-4e6b-91c9-be7a23b8ec76 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154655 Sep 19 15:38:14.626688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 993/1876] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:14 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:38:15.650608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:15.651240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:15.660987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:15.661474 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:15.661921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:15.662627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:15.663083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:15.664387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:15.797040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:15.805165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5fac03d4-e831-41e6-8e09-f6e4db8cc4b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.158751 Sep 19 15:38:15.805727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 884/1877] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:15 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:16.828896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:16.829500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:16.835773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:16.836246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:16.836722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:16.837400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:16.837843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:16.838257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:16.841397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:16.966808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:16.974949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e4ab3857-ae2f-4692-8746-c4533ba77f4f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149922 Sep 19 15:38:16.975525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 994/1878] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:17.999329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:17.999967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:18.006588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:18.007062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:18.007492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:18.008178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:18.008665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:18.009084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:18.011606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:18.142732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:18.150750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-71880648-bea2-44ac-b23b-b73fd96f795f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156242 Sep 19 15:38:18.151317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 885/1879] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:17 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:19.175060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:19.175675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:19.182194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:19.182671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:19.183104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:19.184465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:19.184938 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:19.185362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:19.312701 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:19.320979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5707c3da-17ec-4725-ab07-08e673462b07 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149809 Sep 19 15:38:19.321541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 995/1880] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:19 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:20.344232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:20.344885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:20.351386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:20.351872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:20.352311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:20.353046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:20.353504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:20.353936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:20.491633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:20.500697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2b5b54c8-bb33-4887-9256-56c846213905 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160303 Sep 19 15:38:20.501265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 886/1881] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:21.523536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:21.524175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:21.530638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:21.531113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:21.531543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:21.532222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:21.532703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:21.533122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:21.659191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:21.667240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b657bab3-62d6-41e3-8406-39d79fab27a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.147623 Sep 19 15:38:21.668420 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 996/1882] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:21 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:22.689957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:22.690605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:22.697178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:22.697662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:22.698096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:22.698791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:22.699360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:22.699792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:22.827445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:22.835458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3bba718-481f-48e5-ad89-c8cb7cc5c37e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149440 Sep 19 15:38:22.836018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 887/1883] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:23.859540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:23.860152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:23.866693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:23.867169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:23.867598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:23.868282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:23.868747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:23.869165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:24.000604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:24.008754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ecfecdae-3f6a-4208-839d-33b0382a067c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153848 Sep 19 15:38:24.009343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 997/1884] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:23 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:25.032918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:25.033447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:25.039741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:25.040217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:25.040693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:25.041393 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:25.041845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:25.042272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:25.178712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:25.186989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e00ee04f-23e3-477f-9147-19e58ee53477 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.158018 Sep 19 15:38:25.187544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 888/1885] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:25 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:26.210327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:26.210917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:26.217492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:26.217966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:26.218397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:26.219076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:26.219520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:26.219936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:26.348203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:26.357301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1f23eaab-358f-42c1-a789-e1874c6de417 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150841 Sep 19 15:38:26.357872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 998/1886] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:26 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:27.380546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:27.381104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:27.387540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:27.388020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:27.388464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:27.389175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:27.389629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:27.390053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:27.517364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:27.525410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-886cee4c-9394-46d5-a79a-bdef31c92901 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148931 Sep 19 15:38:27.525975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 889/1887] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:27 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:28.549209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:28.549921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:28.556393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:28.556909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:28.557356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:28.558601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:28.559305 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:28.559739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:28.692358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:28.700648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8a97d64-8f43-4fdd-89c5-3b0c37eb00d4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155385 Sep 19 15:38:28.701215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 999/1888] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:28 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:29.724447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:29.725082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:29.732008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:29.732500 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:29.732942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:29.733631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:29.734080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:29.734499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:29.866706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:29.875741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-47c10ae3-e600-47f7-bda5-0cbe65335a16 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155379 Sep 19 15:38:29.876303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 890/1889] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:29 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:30.898829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:30.899443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:30.906026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:30.906504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:30.906939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:30.907635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:30.908087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:30.908538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:31.039839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:31.048725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-29529c95-5083-454a-a1c3-8a5242cc63f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153767 Sep 19 15:38:31.049279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1000/1890] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:30 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:32.072869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:32.073492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:32.080104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:32.080624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:32.081065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:32.081814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:32.082272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:32.082701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:32.218206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:32.226380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-224a4fa8-0fc7-4cbb-8921-147bc70440a3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157592 Sep 19 15:38:32.226940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 891/1891] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:32 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:33.250999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:33.251603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:33.257947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:33.258415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:33.258840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:33.259516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:33.259961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:33.260375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:33.391685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:33.396105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-47017c29-1056-42ba-a67b-788ca4cd94aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149455 Sep 19 15:38:33.396688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1001/1892] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:33 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:34.419787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:34.420726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:34.427291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:34.427770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:34.428199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:34.428934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:34.429382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:34.429798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:34.561638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:34.569764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e48a86a9-c218-4446-b085-ee490e5d9419 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154480 Sep 19 15:38:34.570327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 892/1893] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:34 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:35.592759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:35.593377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:35.595695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:35.600496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:35.600980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:35.601413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:35.602102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:35.602548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:35.602967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:35.729001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:35.737729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d832f36f-33a6-4152-a965-bb2ba32c98a4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148965 Sep 19 15:38:35.738296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1002/1894] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:35 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:36.762015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:36.762622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:36.764639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:36.769268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:36.769744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:36.770171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:36.770856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:36.771303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:36.771724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:36.898155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:36.906754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-59af233c-1af5-4df5-8956-c7ecae4df5f7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148645 Sep 19 15:38:36.907322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 893/1895] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:36 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:37.929966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:37.930596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:37.937356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:37.937833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:37.938264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:37.938951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:37.939405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:37.939832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:38.071745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:38.080138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-df97585e-107b-4801-8601-44a6176884b5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154270 Sep 19 15:38:38.080757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1003/1896] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:37 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:39.103143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:39.103760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:39.111011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:39.111502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:39.111946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:39.112923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:39.113387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:39.113815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:39.244158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:39.252757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e6158fa4-406e-4bca-a3a9-dbc4042b3efb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153561 Sep 19 15:38:39.253321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 894/1897] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:39 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:40.275712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:40.276338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:40.282771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:40.283251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:40.283683 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:40.284369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:40.284848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:40.290257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:40.417342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:40.426201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ddaf47c-a4d8-4009-ace2-7121b7a9860a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154422 Sep 19 15:38:40.426767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1004/1898] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:40 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:41.450695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:41.451230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:41.457632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:41.458115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:41.458560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:41.459256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:41.459711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:41.460138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:41.586784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:41.595165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-03bffdc4-dea8-4c70-851b-55a3d4565893 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149151 Sep 19 15:38:41.595727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 895/1899] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:41 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:38:42.618582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:42.619205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:42.626941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:42.627484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:42.627926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:42.628664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:42.629120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:42.629546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:42.758976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:42.767425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62eecc3d-5128-40c7-9888-e5f62fa0313b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152875 Sep 19 15:38:42.767985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1005/1900] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:42 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:43.790967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:43.791582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:43.798184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:43.798669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:43.799104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:43.799795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:43.800246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:43.800711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:43.932175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:43.941018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f8af099f-0f61-4b51-984b-5f6c921eb01d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154011 Sep 19 15:38:43.941584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 896/1901] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:43 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:44.964006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:44.964641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:44.971750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:44.972222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:44.972692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:44.973372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:44.973817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:44.974230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:45.103253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:45.111353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d6127546-4e27-44fa-be59-5239a338dd60 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151235 Sep 19 15:38:45.111910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1006/1902] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:44 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:46.135262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:46.135888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:46.142704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:46.143181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:46.143614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:46.144300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:46.144780 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:46.145199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:46.281028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:46.289121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-61e8d107-3e28-4b85-8862-7398c76c08b0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157736 Sep 19 15:38:46.289694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 897/1903] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:46 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:47.312143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:47.312772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:47.319174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:47.319653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:47.320083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:47.320812 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:47.321260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:47.321676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:47.325713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:47.448581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:47.457089 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e6ad4369-68c3-4146-b420-2f738d3f72c6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148851 Sep 19 15:38:47.457648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1007/1904] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:47 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:48.481863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:48.482464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:48.488887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:48.489373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:48.489812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:48.490508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:48.490965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:48.491392 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:48.493971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:38:48.622619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:48.630679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d07553c6-21a2-471d-a328-bc3b7fe0ce8d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153446 Sep 19 15:38:48.631238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 898/1905] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:48 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:49.654046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:49.654671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:49.661284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:49.661762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:49.662191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:49.662872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:49.663317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:49.663736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:49.799661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:49.807932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7148ceb1-460c-4b29-9983-5a8be7dc26a5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.158578 Sep 19 15:38:49.808651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1008/1906] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:50.831140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:50.930587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:50.930587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:50.930587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:50.930587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:50.931828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:50.931828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:50.931828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:50.971380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:50.979563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1108e626-e8fe-445d-8188-22b97a7db148 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152340 Sep 19 15:38:50.980115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 899/1907] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:50 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:52.002993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:52.003583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:52.010033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:52.010509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:52.010940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:52.011696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:52.012144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:52.012591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:52.143280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:52.151520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8059ee2c-3616-41fd-b9bb-7e4fcca99d42 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152443 Sep 19 15:38:52.152084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1009/1908] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:51 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:53.174960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:53.175569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:53.182008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:53.182484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:53.182913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:53.184431 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:53.184909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:53.185331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:53.312923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:53.320962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-57f38c07-854e-4afe-8b65-d1e0da687d9a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149847 Sep 19 15:38:53.321522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 900/1909] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:54.346652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:54.347313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:54.353415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:54.359733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:54.359733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:54.359733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:54.359733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:54.360137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:54.490048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:54.497221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e3ab0872-4a66-4f4b-be98-4e44abd9889f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153222 Sep 19 15:38:54.497875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1010/1910] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:55.521125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:55.521686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:55.528901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:55.529388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:55.529829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:55.530519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:55.530974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:55.531396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:55.662317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:55.671076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-841fa58f-13e5-4a6e-9639-236bac34357d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153867 Sep 19 15:38:55.671642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 901/1911] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:55 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:56.694300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:56.694915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:56.701887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:56.702359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:56.702785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:56.703482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:56.703909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:56.704322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:56.838432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:56.847743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b1d8c73d-6e85-4c73-a37b-e6f6f264f84b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157301 Sep 19 15:38:56.848600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1011/1912] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:56 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:57.871580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:57.872196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:57.879035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:57.879188 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:57.879565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:57.880286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:57.880769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:57.881194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:58.015113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:58.023356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f71a5aec-a9d2-4da2-90a8-d228f0d9c972 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155989 Sep 19 15:38:58.023922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 902/1913] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:57 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:38:59.047142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:38:59.047675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:38:59.054097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:59.054582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:59.055022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:59.055725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:38:59.056182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:38:59.056646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:38:59.186905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:38:59.195006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0373506d-5bd1-4093-bb6b-bc925ab706d2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152219 Sep 19 15:38:59.195563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1012/1914] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:38:59 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:00.219252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:00.219872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:00.226420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.227025 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.227460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:00.228177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:00.228654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:00.229100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:00.361273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:00.369362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1b0519e9-9a13-4b70-b63c-b5da7a527539 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154643 Sep 19 15:39:00.369939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 903/1915] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:01.394353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:01.394899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:01.401261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:01.401743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:01.402180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:01.403633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:01.404095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:01.404543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:01.535868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:01.544445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f8e9fa7-3dd1-414e-bc6f-fa2d38179c44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153919 Sep 19 15:39:01.545023 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1013/1916] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:01 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:39:02.568206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:02.568859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:02.575882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:02.576366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:02.576832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:02.577535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:02.577992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:02.578430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:02.709340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:02.717370 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fa652586-4259-4f0c-96a0-25382e75f10f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153059 Sep 19 15:39:02.717935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 904/1917] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:03.740774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:03.741389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:03.748707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:03.749190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:03.749628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:03.750325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:03.750777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:03.751200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:03.879677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:03.888710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-13f82010-dfc1-4a38-81b7-f13fa31648c8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151751 Sep 19 15:39:03.889275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1014/1918] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:04.911326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:04.911943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:04.918423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:04.918939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:04.919335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:04.920027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:04.920504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:04.920932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:05.048250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:05.056460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8bc47b6a-bafc-4686-b228-355b1ed6003d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149101 Sep 19 15:39:05.057048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 905/1919] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:04 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:06.079517 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:06.080108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:06.082625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:39:06.082774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a (ip 10.222.0.75) !!! Sep 19 15:39:06.084829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:39:06.084971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a (ip 10.222.0.75) !!! Sep 19 15:39:06.086655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:39:06.086777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a (ip 10.222.0.75) !!! Sep 19 15:39:06.087626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:06.096018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:06.096529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:06.096975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:06.097677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:06.098163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:06.098592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:06.239866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:06.244790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-47030cbf-f433-42e3-a983-7b0437995260 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.169188 Sep 19 15:39:06.245363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1015/1920] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:06 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:07.268510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:07.269132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:07.271077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:07.275740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:07.276224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:07.276692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:07.286065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:07.286065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:07.286065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:07.406238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:07.414352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-15458268-599c-406c-bca2-3f6ca57e572b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149963 Sep 19 15:39:07.414922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 906/1921] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:07 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:08.438444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:08.439056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:08.445081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:08.445558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:08.445990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:08.446709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:08.447163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:08.447581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:08.578422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:08.586523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c8330e17-53bd-45b5-9c4a-5054a7c0c41b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152702 Sep 19 15:39:08.587087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1016/1922] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:09.609270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:09.609869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:09.612324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:39:09.612467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a (ip 10.222.0.75) !!! Sep 19 15:39:09.613504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:39:09.613611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a (ip 10.222.0.75) !!! Sep 19 15:39:09.614628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:39:09.614739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a (ip 10.222.0.75) !!! Sep 19 15:39:09.623614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:09.624134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:09.624601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:09.625305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:09.625761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:09.626189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:09.756096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:09.765230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-84275421-f704-4998-8adb-825189b6a4f1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.159859 Sep 19 15:39:09.765802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 907/1923] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:10.693677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:10.694193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:10.700948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:10.701425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:10.701851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:10.702538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:10.702978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:10.703389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:10.729725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:39:10.731395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:10.732042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:10.738211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:10.738797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:10.739551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:10.740518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:10.741055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:10.741551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:10.783918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:39:11.052609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bd6b3e93-f3bc-466e-9dad-6998ddd26e21 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 204 len: 0 microversion: 2.20 time: 0.362443 Sep 19 15:39:11.053320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1017/1924] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:39:10 2022] DELETE /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 15:39:11.058322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6c924071-ec75-4e27-8344-44dce33b9588 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 204 len: 0 microversion: 2.1 time: 0.331223 Sep 19 15:39:11.058526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:11.060531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 908/1925] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:39:10 2022] DELETE /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:39:11.060695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:11.065070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:11.068437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:11.068618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:11.068618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:11.068618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:11.068618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:11.069013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:11.069013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:11.071936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:11.072433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:11.073073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:11.073773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:11.074811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:11.075292 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:11.272473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:11.276438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:11.281720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-49bd279d-226e-4e6a-8806-619fa0180e50 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.227341 Sep 19 15:39:11.282497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1018/1926] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:11 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:11.286975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:11.287571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:11.292223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:11.294468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:11.294638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:11.295285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:11.295790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ce67e646-ac1a-4f45-ba50-706b4faa947d tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1722 microversion: 2.20 time: 0.235727 Sep 19 15:39:11.296217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:11.296657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 909/1927] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:39:11 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:39:11.301384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:11.301384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:11.301384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:11.435744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:11.443820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b611eefb-3e6a-4a4a-a059-8058ecb1c28c tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1674 microversion: 2.1 time: 0.160327 Sep 19 15:39:11.444404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1019/1928] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:11 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:12.307646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:12.309739 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:12.328805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:12.329664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:12.329664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:12.329897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:12.330327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:12.330456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:12.330843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:12.331340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:12.337288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:12.338236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:12.338934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:12.340808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:12.341494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:12.342407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:12.747781 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:12.756970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3e95047c-9a7c-42d7-9d12-0a982f98da96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.453220 Sep 19 15:39:12.757625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 910/1929] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:12.763686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:12.765322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:12.772688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:12.773595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:12.774317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:12.775282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:12.775816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:12.776316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:12.780726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:12.800908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:12.803525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:12.805467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8ae638a1-b80f-4f42-bc12-00f4a46030c2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1722 microversion: 2.20 time: 0.482030 Sep 19 15:39:12.811459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1020/1930] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:39:12 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:39:13.378359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:13.386598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a2594720-f454-4f68-986e-8868133463fa tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1674 microversion: 2.1 time: 0.627827 Sep 19 15:39:13.387251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 911/1931] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:12 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1674 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:13.781473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:13.782120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:13.788694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:13.789182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:13.789615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:13.790316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:13.790765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:13.791185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:13.831710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:13.832331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:13.842343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:13.842818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:13.843254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:13.843988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:13.844625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:13.845050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:14.021140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:14.031711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:14.033261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:14.034878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a143221b-2989-431a-b4aa-933c4d19862c tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1654 microversion: 2.20 time: 0.206794 Sep 19 15:39:14.048908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 912/1932] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:39:13 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1654 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:39:14.240028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:14.250049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-81ff4ff6-9483-42cf-a0ca-c9a30dc3cff3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.472702 Sep 19 15:39:14.250766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1021/1933] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:14.410237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:14.410939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:14.419774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:14.420757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:14.421326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:14.422171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:14.422751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:14.423306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:14.426592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:14.537346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:14.552556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0516fc81-9a3a-4cc4-870c-b766831493b8 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1606 microversion: 2.1 time: 0.144870 Sep 19 15:39:14.554274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 913/1934] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:14 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1606 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:14.604577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-32bef6d6-4d06-4ad1-9f2b-bea0902ae7a2 req-50fa59e6-8978-43e8-846c-95d46b3de199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b26b35-8784-4bb4-8d1b-b962f6104f7f", "name": "network-vif-deleted", "tag": "f96317d7-11bd-464a-9e57-bab13bb12c3f"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:14.617133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-32bef6d6-4d06-4ad1-9f2b-bea0902ae7a2 req-50fa59e6-8978-43e8-846c-95d46b3de199 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:14.617860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-32bef6d6-4d06-4ad1-9f2b-bea0902ae7a2 req-50fa59e6-8978-43e8-846c-95d46b3de199 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:14.618511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-32bef6d6-4d06-4ad1-9f2b-bea0902ae7a2 req-50fa59e6-8978-43e8-846c-95d46b3de199 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:14.625899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:14.636136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-32bef6d6-4d06-4ad1-9f2b-bea0902ae7a2 req-50fa59e6-8978-43e8-846c-95d46b3de199 service nova] Creating event network-vif-deleted:f96317d7-11bd-464a-9e57-bab13bb12c3f for instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f on hv-cinder-75671 Sep 19 15:39:14.644739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-32bef6d6-4d06-4ad1-9f2b-bea0902ae7a2 req-50fa59e6-8978-43e8-846c-95d46b3de199 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144170 Sep 19 15:39:14.645738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1022/1935] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:39:15.062044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:15.062657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:15.070556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.071052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.071472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.072155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.072629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.073045 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.108288 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.108790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.109219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.109849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lazy-loading 'fault' on Instance uuid a99bd356-ddca-4b48-99db-8ea35f0bc190 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:39:15.161213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:15.169936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:15.171381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '808156c7457b4e8b9b6c5f305755b3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de2627ff884f9f9afd68edb0dadf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:15.172914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4515da70-17de-4b8c-b4c6-b07b7c6645a3 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 200 len: 1371 microversion: 2.20 time: 0.115192 Sep 19 15:39:15.173686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 914/1936] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:39:15 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 15:39:15.276349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:15.277106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:15.283631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.284110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.284780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.285488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.285940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.286560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.438374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:15.453966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c0758488-a40c-4dd0-a760-6c74541cab0b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.182826 Sep 19 15:39:15.456909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1023/1937] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:15 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:15.584866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:15.585488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:15.593218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.595270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.595714 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.596427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.596934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.597336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.632318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:15.632889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:15.634177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:15.634979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lazy-loading 'fault' on Instance uuid b3b26b35-8784-4bb4-8d1b-b962f6104f7f {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:39:15.685040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833edf46ef9b4d3982ce49abc74933a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c727384d4ff043809f8421840cbd7596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:15.693791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8941d7b0-bc96-43bd-afa8-9bcea4ba566e tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 200 len: 1328 microversion: 2.1 time: 0.112918 Sep 19 15:39:15.694435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 915/1938] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:15 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:16.198850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:16.199611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:16.205798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.206325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.206753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.207455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.207883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.208300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.221568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 HTTP/1.1 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:39:16.223190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:39:16.225283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'a99bd356-ddca-4b48-99db-8ea35f0bc190'} Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:39:16.226455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:39:16.228255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.229843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:39:16.229843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ec558ceb-4b75-462c-b22a-4fe7666fc1e2 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 404 len: 111 microversion: 2.20 time: 0.029692 Sep 19 15:39:16.229843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1024/1939] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:39:16 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:39:16.234194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-701194e1-8bbf-46a9-b011-46c2f9c8d079 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '.version_select at 0x7f41fb3b9c10>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:16.322187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-701194e1-8bbf-46a9-b011-46c2f9c8d079 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814560511" status: 204 len: 0 microversion: 2.20 time: 0.092556 Sep 19 15:39:16.322766 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 916/1940] 10.222.0.75 () {60 vars in 1262 bytes} [Mon Sep 19 15:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814560511 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 15:39:16.479360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:16.479978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:16.487241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.491894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.491894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.491894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.491894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.492291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.661243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-128836ba-9bc9-47c7-821d-72e1c4774704 req-3086cb95-bd5b-4b4d-9969-009a1cc841f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99bd356-ddca-4b48-99db-8ea35f0bc190", "name": "network-vif-deleted", "tag": "1c21fec3-1ba6-4250-9249-a9d49c1148ad"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:39:16.686862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-128836ba-9bc9-47c7-821d-72e1c4774704 req-3086cb95-bd5b-4b4d-9969-009a1cc841f3 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.686862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-128836ba-9bc9-47c7-821d-72e1c4774704 req-3086cb95-bd5b-4b4d-9969-009a1cc841f3 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.686862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-128836ba-9bc9-47c7-821d-72e1c4774704 req-3086cb95-bd5b-4b4d-9969-009a1cc841f3 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.697810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-128836ba-9bc9-47c7-821d-72e1c4774704 req-3086cb95-bd5b-4b4d-9969-009a1cc841f3 service nova] Creating event network-vif-deleted:1c21fec3-1ba6-4250-9249-a9d49c1148ad for instance a99bd356-ddca-4b48-99db-8ea35f0bc190 on hv-cinder-75671 Sep 19 15:39:16.703090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-128836ba-9bc9-47c7-821d-72e1c4774704 req-3086cb95-bd5b-4b4d-9969-009a1cc841f3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045534 Sep 19 15:39:16.703687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 917/1941] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:39:16.720815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:16.721621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:16.727754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.728243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.728726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.729490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:16.729959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:16.730394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:16.745473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f HTTP/1.1 Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:39:16.750009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:39:16.751798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'b3b26b35-8784-4bb4-8d1b-b962f6104f7f'} Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:39:16.752697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:39:16.755930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:39:16.759055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:39:16.759055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-35c3afa2-9bad-41e0-8cf5-c887544be2b1 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 404 len: 111 microversion: 2.1 time: 0.039771 Sep 19 15:39:16.759384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f78e06a4-5a48-4c68-8a1d-e7b490c1de47 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.283773 Sep 19 15:39:16.760507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 918/1942] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:16 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:39:16.765731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b9602598-b148-420f-bd7d-efa4c91dc639 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '.version_select at 0x7f41fb3b9c10>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:16.774945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1025/1943] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:16.860315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b9602598-b148-420f-bd7d-efa4c91dc639 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837030334" status: 202 len: 0 microversion: 2.1 time: 0.098732 Sep 19 15:39:16.861203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 919/1944] 10.222.0.75 () {58 vars in 1221 bytes} [Mon Sep 19 15:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837030334 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:39:17.782042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:17.782654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:17.789278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:17.789753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:17.790181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:17.790870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:17.791317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:17.791733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:17.924112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:17.932178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7658fde7-2072-493a-b3bb-4eaaba032ae4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154730 Sep 19 15:39:17.932752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1026/1945] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:17 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:18.956046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:18.956674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:18.963327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:18.963807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:18.964242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:18.964966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:18.966069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:18.966486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:19.095193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:19.103325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3a316d8-05ef-427e-9bfb-e18a6343fcc0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151850 Sep 19 15:39:19.103926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 920/1946] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:18 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:20.129894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:20.130508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:20.137557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:20.138114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:20.138550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:20.139240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:20.139691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:20.140119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:20.270327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:20.278623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-730b6a2f-203f-4118-b4f6-821a00e664b9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152569 Sep 19 15:39:20.279180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1027/1947] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:21.302464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:21.303243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:21.311269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:21.311903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:21.312543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:21.313450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:21.314022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:21.314552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:21.446056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:21.455069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0506b0e1-8c22-4b4e-a804-b1556a626fe2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157160 Sep 19 15:39:21.455642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 921/1948] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:21 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:22.478839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:22.479650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:22.486692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:22.487229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:22.487679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:22.488404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:22.488887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:22.489312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:22.617129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:22.625603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4863982e-3f62-4aa5-b18d-dcec47ccc6aa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150858 Sep 19 15:39:22.626161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1028/1949] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:23.649126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:23.649738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:23.656364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:23.656879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:23.657317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:23.658014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:23.658472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:23.658897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:23.790721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:23.800160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c9a2375d-6306-4bce-99da-c83d9e2fdc2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154869 Sep 19 15:39:23.800754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 922/1950] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:23 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:24.823300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:24.823945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:24.831058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:24.831544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:24.831982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:24.832705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:24.833162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:24.833590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:24.959617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:24.968155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4d7daecc-8733-43d9-9459-3ce86acb745f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148826 Sep 19 15:39:24.968750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1029/1951] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:24 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:25.991459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:25.992074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:25.999381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:25.999862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.000301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.001055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:26.001510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:26.001935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:26.134695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:26.143340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-553ed370-c42f-4be7-bbdd-6233a48eb35f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155915 Sep 19 15:39:26.143899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 923/1952] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:25 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:27.167053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:27.167661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:27.174910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:27.175389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:27.175816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:27.176516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:27.176988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:27.177402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:27.305627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:27.314545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8a0279a-bf5a-432a-a7be-9b1b32c006f5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151372 Sep 19 15:39:27.315108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1030/1953] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:27 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:28.338206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:28.338800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:28.345299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:28.345775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:28.346205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:28.346888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:28.347335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:28.347751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:28.483167 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:28.491272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0a4d0690-f656-44f4-a9e8-95cc85256892 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156971 Sep 19 15:39:28.491832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 924/1954] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:28 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:29.520253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:29.520253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:29.522533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:29.523014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:29.523501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:29.524198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:29.524686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:29.525110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:29.661265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:29.670086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-50b88869-90b8-4a56-8be1-c00ae11ceabb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.159432 Sep 19 15:39:29.670638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1031/1955] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:29 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:30.694215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:30.694858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:30.702174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:30.702655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:30.703114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:30.703788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:30.704239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:30.704771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:30.834184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:30.842662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33329b8d-a930-4720-8851-33d250769de8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152400 Sep 19 15:39:30.843229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 925/1956] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:30 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:31.865657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:31.866303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:31.873771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:31.874303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:31.874830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:31.875673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:31.876210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:31.876679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:32.026704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:32.029482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aa94844e-b1dd-40da-a73c-e3f66453ad4c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.166969 Sep 19 15:39:32.029996 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1032/1957] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:31 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:33.052559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:33.053113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:33.059495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:33.060265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:33.060759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:33.061468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:33.061928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:33.062355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:33.189657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:33.197761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6b1da43d-e920-4d17-a4ee-c425050dc6d6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149211 Sep 19 15:39:33.198315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 926/1958] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:33 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:34.221679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:34.222294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:34.228761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:34.229269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:34.229707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:34.230394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:34.230843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:34.231261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:34.364464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:34.372759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b6d0d563-a67f-4780-9cde-268d8c850e91 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155493 Sep 19 15:39:34.373312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1033/1959] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:34 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:35.396427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:35.397231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:35.405027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:35.405576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:35.406226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:35.407341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:35.407856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:35.414769 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:35.544121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:35.553013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1510d6a8-f219-4f4d-972a-9ab5276eb866 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161742 Sep 19 15:39:35.553585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 927/1960] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:35 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:36.576007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:36.576687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:36.578837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:36.584166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:36.584685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:36.585117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:36.585836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:36.586288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:36.586709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:36.716307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:36.724912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c17f6992-e2b4-49c9-b441-851ee8e8eaff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152691 Sep 19 15:39:36.725482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1034/1961] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:36 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:37.749532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:37.750158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:37.752175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:37.757760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:37.758249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:37.758692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:37.759396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:37.759855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:37.760286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:37.892670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:37.901491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dd1c975c-be97-4afb-bc9f-ded162a9598e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156312 Sep 19 15:39:37.902059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 928/1962] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:37 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:38.924335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:38.924986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:38.931452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:38.931929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:38.932361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:38.933074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:38.933525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:38.933943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:39.068010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:39.076220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c83b770a-da60-4b4b-b83f-c632bbeba582 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155774 Sep 19 15:39:39.076827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1035/1963] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:38 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:40.100520 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:40.101114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:40.107417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:40.107897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:40.108361 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:40.109101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:40.109548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:40.109965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:40.241603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:40.250074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7e3fcf89-f38a-4e84-b078-f714704b1dd6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153928 Sep 19 15:39:40.250638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 929/1964] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:40 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:41.272851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:41.273452 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:41.279830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:41.280804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:41.281630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:41.282331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:41.282781 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:41.283199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:41.414596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:41.423018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6732e49f-e495-47e6-860a-52abe1177b86 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154746 Sep 19 15:39:41.427628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1036/1965] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:41 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:42.446887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:42.447497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:42.453979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:42.458789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:42.458789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:42.458789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:42.458789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:42.459204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:42.595782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:42.604136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a5284ed9-6200-4937-a8a7-c02ada76c278 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161999 Sep 19 15:39:42.604742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 930/1966] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:42 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:43.629187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:43.630012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:43.638653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:43.639247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:43.639815 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:43.640765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:43.641369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:43.641893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:43.773358 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:43.781560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5e199346-b95a-46c3-9063-8dbda5104104 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157345 Sep 19 15:39:43.782121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1037/1967] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:43 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:44.805551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:44.806158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:44.812619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:44.813101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:44.813535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:44.814228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:44.814677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:44.815100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:44.817643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=92 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:44.944363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:44.952750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c7d89efd-4107-4fd5-ba1b-7e49bf9b02bf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151081 Sep 19 15:39:44.953306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 931/1968] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:44 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:45.976280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:45.977639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:45.984064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:45.984586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:45.985027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:45.985717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:45.986168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:45.986592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:45.989147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=88 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:39:46.118303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:46.127004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0da03bc3-ce7e-4fdd-892b-a5d4f4e476ec tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154586 Sep 19 15:39:46.127579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1038/1969] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:45 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:47.151427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:47.152052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:47.158756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:47.159113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:47.159548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:47.160305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:47.160793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:47.161218 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:47.288498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:47.297291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2735c626-c378-431d-83c9-cdf01fc28d5d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150589 Sep 19 15:39:47.297849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 932/1970] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:47 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:48.320289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:48.321571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:48.328132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:48.328646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:48.329084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:48.329770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:48.330225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:48.330646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:48.461464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:48.470766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-15dde957-a83c-441d-9369-65b4e026847c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154452 Sep 19 15:39:48.471453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1039/1971] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:48 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:49.494745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:49.495296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:49.501978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:49.502461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:49.502898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:49.503592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:49.504044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:49.504469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:49.633005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:49.641832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4a6bba3e-0f56-46d2-af7f-2c606f769b8f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151136 Sep 19 15:39:49.642395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 933/1972] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:50.665187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:50.666541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:50.673056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:50.673543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:50.673983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:50.674703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:50.675154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:50.675576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:50.814962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:50.821645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-811164ed-03a9-4845-960f-97eb465a36bd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160434 Sep 19 15:39:50.822775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1040/1973] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:50 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:51.845028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:51.845652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:51.852066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:51.852583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:51.853027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:51.853741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:51.854199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:51.854626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:51.984067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:51.992457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5eec2e5d-1bf4-4933-a542-3c0c392cf4a2 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151329 Sep 19 15:39:51.993049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 934/1974] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:51 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:53.016145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:53.016819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:53.023191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:53.023669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:53.024101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:53.024824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:53.025280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:53.025702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:53.160178 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:53.169545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-00e40550-814e-41e3-ad80-60e9788295a0 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157215 Sep 19 15:39:53.170109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1041/1975] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:54.192913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:54.193571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:54.200713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:54.201202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:54.201644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:54.202349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:54.202808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:54.203237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:54.335712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:54.346988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6f4a0bbc-4882-48a7-881f-5512ef89961d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157807 Sep 19 15:39:54.347852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 935/1976] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:55.371737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:55.372338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:55.379132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:55.379604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:55.380029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:55.380740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:55.381184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:55.381689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:55.514479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:55.522631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4e2b2432-2156-4479-b2e2-fe11e6a51d0a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155510 Sep 19 15:39:55.523198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1042/1977] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:55 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:56.545723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:56.546759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:56.553199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:56.553684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:56.554125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:56.554825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:56.555283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:56.555712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:56.694119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:56.702700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-02e42c2f-d85e-4501-8ac6-87b69d53f84f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161027 Sep 19 15:39:56.703262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 936/1978] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:56 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:57.726763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:57.727355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:57.733830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:57.734304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:57.734735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:57.735417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:57.735926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:57.736279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:57.867219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:57.876520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e607c969-3e38-434a-8718-e1b1e8777661 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153681 Sep 19 15:39:57.877075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1043/1979] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:57 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:39:58.900567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:39:58.901118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:39:58.908197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:58.908724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:58.909164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:58.909862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:39:58.910320 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:39:58.910749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:39:59.042514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:39:59.050889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f41bccef-1485-4356-b998-6b9003f72352 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154311 Sep 19 15:39:59.051454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 937/1980] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:39:58 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:40:00.073826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:00.074444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:00.081283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:00.081765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:00.082197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:00.082903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:00.083335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:00.083764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:00.216862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:00.225057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-05a869b7-078d-4ad9-9d15-c3e4fef5517b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155096 Sep 19 15:40:00.225624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1044/1981] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:01.247972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:01.248613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:01.255193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:01.255666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:01.256106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:01.256835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:01.257303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:01.257732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:01.386095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:01.394743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-134673dd-edd2-4383-a90b-34fa20127e96 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150972 Sep 19 15:40:01.395308 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 938/1982] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:01 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:02.438072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:02.438788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:02.445340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:02.445821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:02.446260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:02.446949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:02.447398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:02.447817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:02.594005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:02.602250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-27160b56-25e9-4095-a95b-3583891233ff tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.168463 Sep 19 15:40:02.602803 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1045/1983] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:03.625423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:03.626041 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:03.632542 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:03.633030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:03.633466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:03.634161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:03.634619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:03.635044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:03.766178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:03.774371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a3972077-82c9-455a-b8a0-369d060931af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153117 Sep 19 15:40:03.774935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 939/1984] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:04.798151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:04.798764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:04.805484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:04.805878 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:04.806320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:04.807050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:04.807537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:04.807994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:04.939955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:04.948270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-97940019-ecbb-4451-ad3a-e42e5422cee7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154544 Sep 19 15:40:04.948855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1046/1985] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:04 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:05.973461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:05.974082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:05.980610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:05.981135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:05.981728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:05.982512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:05.982977 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:05.983405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:06.114472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:06.123590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a911540c-e21b-4687-9f66-81f3c2fde72a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153971 Sep 19 15:40:06.124148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 940/1986] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:05 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:07.146091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:07.146702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:07.148573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:07.153314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:07.153790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:07.154222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:07.154912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:07.155406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:07.155826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:07.283164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:07.291207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0b4efb4d-79d7-4423-856e-035f1270af48 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149159 Sep 19 15:40:07.291759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1047/1987] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:07 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:08.314526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:08.315147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:08.317493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:08.322220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:08.322717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:08.323158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:08.323855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:08.324312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:08.325405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:08.889875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:08.898168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ae07d1bf-1d69-494e-bfeb-414f6bacb2eb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.587500 Sep 19 15:40:08.898747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 941/1988] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:09.921198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:09.921778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:09.928176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:09.928693 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:09.929129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:09.929820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:09.930281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:09.930704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:10.060099 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:10.068551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ca97ff04-f2af-44f0-8da7-7289de9c502d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151227 Sep 19 15:40:10.069102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1048/1989] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:11.091216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:11.091872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:11.098176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:11.098672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:11.099117 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:11.099818 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:11.100278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:11.100732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:11.236581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:11.244855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6b7b5d6a-024f-4665-90f2-20eeac8e8715 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157735 Sep 19 15:40:11.245429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 942/1990] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:11 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:12.269247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:12.269864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:12.276729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:12.277239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:12.277733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:12.278636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:12.279090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:12.279509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:12.406346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:12.414603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a1c95a39-f7a6-4e0a-b420-1c791fd63634 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149314 Sep 19 15:40:12.415210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1049/1991] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:13.438304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:13.438873 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:13.445443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:13.445926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:13.446359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:13.447049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:13.447494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:13.447919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:13.588231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:13.596764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e63bdfbc-088a-40f9-a44d-866d4295c418 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.162352 Sep 19 15:40:13.597419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 943/1992] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:14.626446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:14.627090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:14.633018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:14.633495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:14.633926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:14.634610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:14.635062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:14.635488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:14.766588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:14.774895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c72570ec-26f8-489b-9d34-544b29805b6c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153765 Sep 19 15:40:14.775472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1050/1993] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:14 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:15.798676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:15.799293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:15.805682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:15.806163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:15.806604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:15.807296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:15.807751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:15.808178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:15.812187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:15.939239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:15.947374 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2bd7863c-b014-4f73-afde-7c1c18ee4fe9 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152554 Sep 19 15:40:15.947937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 944/1994] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:15 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:16.971432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:16.972028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:16.978485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:16.978962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:16.979392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:16.980076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:16.981265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:16.981710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:16.984213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:17.114614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:17.123858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-59f34315-ba81-40f5-bc52-31c4fa95e832 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156347 Sep 19 15:40:17.124533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1051/1995] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:18.147831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:18.148432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:18.157574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:18.158259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:18.158956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:18.160058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:18.160821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:18.161557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:18.297001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:18.305611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2fb9239f-6b36-4f50-a3bb-6bdea8846387 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.161649 Sep 19 15:40:18.306390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 945/1996] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:18 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:19.329675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:19.330319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:19.336750 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:19.337235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:19.337676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:19.338371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:19.338829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:19.339256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:19.471990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:19.480233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-feecc4a8-371b-4766-9236-f285fefcfc93 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154436 Sep 19 15:40:19.481381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1052/1997] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:19 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:20.503985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:20.504635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:20.511010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.511497 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.511980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.512734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:20.513193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:20.513622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:20.648753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:20.658169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3d620a1f-c21d-4702-8bf9-85177773bb80 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.158200 Sep 19 15:40:20.658761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 946/1998] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:21.680375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:21.681027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:21.688461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:21.688969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:21.689399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:21.690091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:21.690539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:21.690956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:21.825756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:21.834090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-43390de0-3962-4d3f-a91b-aef3703d72fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157599 Sep 19 15:40:21.834653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1053/1999] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:21 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:22.858123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:22.858778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:22.865190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:22.865674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:22.866113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:22.866819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:22.867270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:22.867701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:23.003506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:23.013930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6a9fb8ce-c88e-4a08-a20f-8d422e7ce479 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160283 Sep 19 15:40:23.014650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 947/2000] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:24.037363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:24.037902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:24.045414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:24.045893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:24.046320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:24.047007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:24.047460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:24.047874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:24.178292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:24.186471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-185d437b-30fb-4842-8cf8-acb6b427e199 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153028 Sep 19 15:40:24.187029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1054/2001] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:24 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:25.209077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:25.209694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:25.216225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:25.216740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:25.217181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:25.217878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:25.218336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:25.218765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:25.347182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:25.355813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-eccadb8c-5c04-4671-85fe-184811919ecf tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150121 Sep 19 15:40:25.356380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 948/2002] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:25 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:26.378558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:26.379124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:26.385560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:26.386043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:26.386480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:26.388010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:26.388466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:26.388918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:26.522123 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:26.530780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f532427d-36ca-4600-a1a0-2fef891828c7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156194 Sep 19 15:40:26.531350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1055/2003] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:26 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:27.554229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:27.554844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:27.561878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:27.562359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:27.562792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:27.563484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:27.563939 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:27.564360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:27.697026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:27.705703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cfea201a-2389-49d9-8084-fec0158795af tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155447 Sep 19 15:40:27.706268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 949/2004] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:27 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:28.731674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:28.732297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:28.738740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:28.739221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:28.739653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:28.740344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:28.740834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:28.741258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:28.870273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:28.879389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2a6252a3-233c-4f37-936f-a722d8f75189 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154138 Sep 19 15:40:28.879955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1056/2005] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:28 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:29.903177 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:29.903775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:29.910889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:29.911422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:29.911858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:29.912576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:29.913035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:29.913459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:30.046189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:30.054327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea8971d1-9313-46f8-92e5-854f379ff70f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155810 Sep 19 15:40:30.054892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 950/2006] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:29 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:31.082976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:31.083595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:31.090575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:31.091054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:31.091486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:31.092174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:31.092654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:31.093078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:31.224748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:31.233522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b25196ec-b4ca-4366-957f-b72649ff5b7b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154411 Sep 19 15:40:31.234130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1057/2007] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:31 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:32.257438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:32.257438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:32.264501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:32.264989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:32.265427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:32.266128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:32.266587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:32.267018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:32.399221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:32.405295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ecfb4932-5384-48e3-a0cf-a6eec9286410 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152438 Sep 19 15:40:32.405856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 951/2008] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:32 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:33.428744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:33.429392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:33.436601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:33.437027 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:33.437462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:33.438174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:33.438622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:33.439040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:33.581488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:33.589819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-59e4c6b6-a04b-4f6e-9134-e99c3a1e2202 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.164810 Sep 19 15:40:33.590385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1058/2009] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:33 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:34.612410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:34.613069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:34.619482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:34.620007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:34.622401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:34.622401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:34.622401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:34.622401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:34.760018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:34.768000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4467c6ba-59e8-4504-b77d-5f2fdf9a291d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.159497 Sep 19 15:40:34.768583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 952/2010] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:34 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:35.791475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:35.792094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:35.798562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:35.799041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:35.799472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:35.800155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:35.800638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:35.801062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:35.934345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:35.942499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ec917221-314a-487b-a92b-dca7da86cdbe tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154964 Sep 19 15:40:35.943064 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1059/2011] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:35 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:36.965668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:36.966199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:36.972220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:36.972730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:36.973161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:36.973842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:36.974291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:36.974718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:37.103750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:37.112685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-400eb778-9e7a-42e4-9617-dc8c1fb25c3c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151113 Sep 19 15:40:37.113271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 953/2012] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:36 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:38.137516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:38.138160 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:38.140119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:38.144789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:38.145273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:38.145710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:38.146395 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:38.146848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:38.147280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:38.275622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:38.284057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-27587d09-d436-4131-8e11-88394b2cba31 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151176 Sep 19 15:40:38.284651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1060/2013] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:38 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:39.306700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:39.307322 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:39.309872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:39.314557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:39.315040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:39.315485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:39.316179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:39.316671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:39.317100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:39.449846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:39.458005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a8e1b363-370f-47d0-b327-312aa61f20dd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155219 Sep 19 15:40:39.458563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 954/2014] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:39 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:40.481093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:40.481711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:40.488105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:40.488625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:40.489053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:40.489736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:40.490182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:40.490602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:40.618811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:40.627920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5e0ba9be-c133-416a-987e-2363520115e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150773 Sep 19 15:40:40.628510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1061/2015] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:40 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:41.651291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:41.651889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:41.658546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:41.659028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:41.659453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:41.660134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:41.660609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:41.661027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:41.792667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:41.801339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2ac0310a-95cf-4817-9d9b-43b1d56d6722 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153941 Sep 19 15:40:41.801906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 955/2016] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:41 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:42.825220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:42.825841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:42.832894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:42.833377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:42.833819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:42.834504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:42.834955 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:42.835378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:42.963013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:42.971246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a60cc23e-9359-4b71-9ac4-58818a4bb73d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149943 Sep 19 15:40:42.971814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1062/2017] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:42 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:43.995344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:43.995944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:44.003000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:44.003479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:44.003903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:44.004622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:44.005072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:44.005490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:44.145992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:44.154227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f80fbff8-1353-4672-9389-934a889729fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.162754 Sep 19 15:40:44.154794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 956/2018] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:43 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:45.181568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:45.182187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:45.193850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:45.193850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:45.193850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:45.193850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:45.194370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:45.194370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:45.370483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:45.379084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6e3da08c-b927-43bf-b7c0-f3b648b8520b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.201327 Sep 19 15:40:45.379667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1063/2019] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:45 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:46.402432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:46.403047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:46.410187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:46.410669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:46.411107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:46.411797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:46.412255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:46.412713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:46.416664 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:46.541033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:46.549480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6d255400-24bd-482e-91d7-394431a23149 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150886 Sep 19 15:40:46.550040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 957/2020] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:46 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:47.572624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:47.573242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:47.581065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:47.581538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:47.581968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:47.582650 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:47.583096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:47.583512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:47.586082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:40:47.714732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:47.723443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6c0c0dc8-9bf1-4630-9793-8b3a23d6abbb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154748 Sep 19 15:40:47.724004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1064/2021] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:47 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:48.746989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:48.747662 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:48.754972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:48.755459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:48.755898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:48.756673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:48.757143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:48.757578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:48.888708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:48.897569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-02484908-02a6-4e00-a3cc-5135b53541fc tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154710 Sep 19 15:40:48.898131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 958/2022] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:48 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:49.920941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:49.921832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:49.928416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:49.928934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:49.929375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:49.930063 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:49.930520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:49.930944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:50.062230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:50.070432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c5eb1e98-787a-4e31-afb5-f684b568cd2b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153520 Sep 19 15:40:50.070991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1065/2023] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:51.095377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:51.095999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:51.103248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:51.103735 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:51.104174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:51.104905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:51.105365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:51.105800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:51.235175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:51.243384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-70470f65-a106-4183-96c2-a97c3cb5e50c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152592 Sep 19 15:40:51.243951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 959/2024] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:51 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:52.266830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:52.267426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:52.273837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:52.274314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:52.274741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:52.275417 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:52.275862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:52.276281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:52.404672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:52.413421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2833e154-87c3-4052-8bb9-6349cea048d8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150552 Sep 19 15:40:52.413980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1066/2025] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:52 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:53.437536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:53.438154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:53.444931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:53.445362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:53.445797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:53.446519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:53.446973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:53.447424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:53.576869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:53.585686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-149eb149-214e-4fc5-92e2-412a82edcd74 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152395 Sep 19 15:40:53.586245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 960/2026] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:53 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:54.609855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:54.610456 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:54.616931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:54.617403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:54.617862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:54.618533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:54.618978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:54.619391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:54.755615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:54.764192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-00359f5b-7c60-4bc0-8594-2315e1bd210b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.158304 Sep 19 15:40:54.764873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1067/2027] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:54 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:55.787434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:55.788048 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:55.796211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.796719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.797149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.797846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:55.798293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:55.798711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:55.933159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:55.941386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a69ee3e2-45a5-4ee3-93e4-c4fa57c85608 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157943 Sep 19 15:40:55.941948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 961/2028] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:55 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:56.964046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:56.964800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:56.971699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:56.972181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:56.972653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:56.973343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:56.973796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:56.974221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:57.101543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:57.110433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0c9cf4d-8ac8-405c-a5a0-5974d2500614 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150238 Sep 19 15:40:57.110997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1068/2029] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:56 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:58.133734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:58.134350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:58.141418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:58.141888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:58.142316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:58.143000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:58.143447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:58.143864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:58.277750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:58.286548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-48aa2ab5-23ea-4e13-adbb-4c781f92aa44 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156676 Sep 19 15:40:58.287109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 962/2030] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:58 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:40:59.309982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:40:59.310595 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:40:59.317575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:59.318052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:59.318481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:59.319163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:40:59.319605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:40:59.320018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:40:59.447777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:40:59.456261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-53b1d23a-ba9a-4bf2-9b88-5381e881d67a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150349 Sep 19 15:40:59.456845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1069/2031] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:40:59 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:00.479751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:00.480353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:00.486907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:00.487382 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:00.487808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:00.488505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:00.488960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:00.489375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:00.616430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:00.625687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-81a27aa1-acb4-48fe-9b15-923b4a5b7762 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149769 Sep 19 15:41:00.626251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 963/2032] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:00 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:01.649312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:01.649920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:01.657274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:01.657751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:01.658190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:01.658872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:01.659319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:01.659738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:01.789676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:01.797893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5f19c9b7-e14d-4b56-b395-4d085ae04c14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152534 Sep 19 15:41:01.798450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1070/2033] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:01 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:02.821054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:02.821668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:02.828702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:02.829209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:02.829647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:02.830338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:02.830793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:02.831217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:02.959286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:02.967413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-331d658c-5080-460c-91f6-fb51d9668099 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150272 Sep 19 15:41:02.967974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 964/2034] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:02 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:03.990538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:03.991156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:03.997887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:03.998370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:03.998869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:03.999566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:04.000015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:04.000437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:04.130890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:04.139015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ee6132f-2a99-40b2-9c20-87c5840abe43 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152449 Sep 19 15:41:04.140097 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1071/2035] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:03 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:05.161883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:05.162494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:05.169001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:05.169477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:05.169913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:05.171189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:05.171641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:05.172064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:05.303716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:05.312807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5238c136-11f3-4ce4-a76d-ee2966f2744a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154571 Sep 19 15:41:05.313373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 965/2036] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:05 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:06.336927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:06.337678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:06.344998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.345489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.345924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.346628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:06.347083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:06.347508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:06.481797 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:06.490483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e359c59c-d7d7-490e-8cf2-6dc96bd7e9ef tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157587 Sep 19 15:41:06.491055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1072/2037] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:06 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:07.512683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:07.513303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:07.520134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:07.520656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:07.521092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:07.521816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:07.522269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:07.522695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:07.652824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:07.660932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fe6a7d25-f237-406f-9b2f-ad13f9b596ca tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152102 Sep 19 15:41:07.661489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 966/2038] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:07 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:08.683199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:08.683733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:08.686046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:08.690706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:08.691183 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:08.691617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:08.692327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:08.692798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:08.693217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:08.828206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:08.836362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-64fb36ec-a419-4aee-b388-e76e4759826e tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157105 Sep 19 15:41:08.836947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1073/2039] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:08 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:09.860294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:09.860946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:09.863228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:09.867909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.868383 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.868849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:09.869533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:09.869979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:09.870399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:10.005016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:10.013377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-123e4b21-e81e-488d-b5c3-3373cb1583ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156922 Sep 19 15:41:10.013940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 967/2040] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:09 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:11.038808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:11.039425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:11.046746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:11.047229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:11.047663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:11.048357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:11.048838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:11.049260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:11.178131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:11.186934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3c6a1f4c-b2f2-41cd-add7-c2a50a4e9c97 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152072 Sep 19 15:41:11.187586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1074/2041] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:11 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:12.210488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:12.211102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:12.217708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:12.218197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:12.218632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:12.219328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:12.219784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:12.220212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:12.354912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:12.364052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c24c297c-a6b1-46b3-8359-56cc0fe445ed tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157471 Sep 19 15:41:12.364690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 968/2042] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:12 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:13.388223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:13.388855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:13.395980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:13.396451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:13.396906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:13.397585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:13.398032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:13.398446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:13.525047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:13.533050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8aceb198-6153-41d8-ae8d-51faec3f14fa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148702 Sep 19 15:41:13.533610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1075/2043] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:13 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:14.555223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:14.555841 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:14.562366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:14.562875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:14.563340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:14.564033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:14.564505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:14.564942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:14.709343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:14.718397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-df081636-f5a6-4900-962a-94eb8bd3812d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.166244 Sep 19 15:41:14.719079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 969/2044] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:14 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:15.745617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:15.746227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:15.753101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:15.753582 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:15.754013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:15.754705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:15.755152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:15.755568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:15.890697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:15.899252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-153a1fa1-9f18-476b-80e2-bb0d153475b3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157463 Sep 19 15:41:15.899813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1076/2045] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:15 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:16.922856 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:16.923518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:16.936595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:16.936595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:16.936595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:16.936595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:16.937338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:16.937338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:16.937338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:17.091155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:17.100146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cd165da5-0d8e-4fb9-b7d6-e8090c9b6fda tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.181699 Sep 19 15:41:17.100771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 970/2046] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:16 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:18.123199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:18.123831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:18.130201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:18.130673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:18.131100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:18.131782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:18.132226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:18.132688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:18.135149 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:18.265919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:18.274136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-871e4d91-2558-4efd-aa31-04bd3e15290b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154999 Sep 19 15:41:18.274692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1077/2047] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:18 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:19.297715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:19.298269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:19.304708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:19.305187 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:19.305623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:19.306311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:19.306767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:19.307189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:19.439314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:19.447410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-14588514-71f8-45dc-a591-8ec0635a3629 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153674 Sep 19 15:41:19.447998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 971/2048] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:19 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:20.472210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:20.472885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:20.479479 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:20.479965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:20.480400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:20.481116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:20.481568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:20.481987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:20.615865 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:20.624283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f9766449-915b-4eef-8b03-c03e165395fb tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.156388 Sep 19 15:41:20.624941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1078/2049] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:20 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:21.647270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:21.647916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:21.654415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:21.655209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:21.655688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:21.656395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:21.656885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:21.657316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:21.785331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:21.793618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5ca565ad-67d5-4deb-8895-45606b602c79 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150288 Sep 19 15:41:21.794183 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 972/2050] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:21 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:22.816864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:22.817483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:22.823861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:22.824333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:22.824798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:22.825477 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:22.825922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:22.826890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:22.965043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:22.973960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d95d84b7-053a-477f-8c0b-0039b5a5f9e4 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160969 Sep 19 15:41:22.974526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1079/2051] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:22 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:23.997357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:23.997975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:24.004757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:24.005269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:24.005707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:24.006420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:24.006877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:24.007317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:24.135894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:24.144111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5fd50327-77d8-42d4-819c-b706518833d3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150950 Sep 19 15:41:24.144711 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 973/2052] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:23 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:25.167561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:25.168162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:25.175304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:25.175776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:25.176200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:25.176904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:25.177348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:25.177758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:25.304790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:25.313492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d947f5bf-04a9-42a9-b180-8b05663e4c1d tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149851 Sep 19 15:41:25.314055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1080/2053] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:25 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:26.339253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:26.339902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:26.346368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:26.346853 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:26.347294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:26.347999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:26.348459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:26.348912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:26.480436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:26.489207 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c5ca16d7-256d-4f77-8850-8aaac574b7c3 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.153823 Sep 19 15:41:26.489776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 974/2054] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:26 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:27.517757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:27.518943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:27.525352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:27.525840 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:27.526281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:27.526979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:27.527440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:27.527863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:27.687364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:27.695597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-39c26032-69b0-44ba-a430-310fd1560c13 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.182242 Sep 19 15:41:27.696165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1081/2055] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:27 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:28.719597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:28.720205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:28.726687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:28.727195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:28.727624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:28.728316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:28.728791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:28.729243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:28.861234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:28.869468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-31471d8c-a33b-4be1-b4f8-fe954c5b9a5c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.154237 Sep 19 15:41:28.870030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 975/2056] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:28 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:29.897299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:29.897883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:29.904775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:29.905325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:29.905768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:29.906451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:29.906903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:29.907325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:30.036999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:30.046483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9bb775c6-a942-4e15-ab27-510fc07b986f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152978 Sep 19 15:41:30.047170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1082/2057] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:29 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:31.071095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:31.071718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:31.078297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:31.078783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:31.079220 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:31.079918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:31.080372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:31.080824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:31.209667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:31.218040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2f285556-5e73-495b-a1c5-ac3d8798aa30 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150806 Sep 19 15:41:31.218608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 976/2058] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:31 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:32.241483 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:32.242107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:32.249094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:32.249585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:32.250025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:32.250714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:32.251170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:32.251596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:32.381182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:32.389329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-648e8876-7e4a-4717-b227-36074f87fdaa tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.151837 Sep 19 15:41:32.389884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1083/2059] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:32 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:33.413936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:33.414534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:33.421274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:33.421760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:33.422196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:33.422891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:33.423344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:33.423768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:33.550528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:33.558643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ef491ad1-56c9-4c8f-b4cd-3c6e4a2fda8a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.149835 Sep 19 15:41:33.559202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 977/2060] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:33 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:34.582346 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:34.582988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:34.589436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:34.589911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:34.590343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:34.591017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:34.591471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:34.591913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:34.725013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:34.733909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2fc22f28-a61d-4700-9214-3ffbb5d9241b tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155488 Sep 19 15:41:34.734462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1084/2061] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:34 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:35.757136 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:35.757790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:35.764276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:35.764828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:35.765235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:35.765927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:35.766384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:35.766815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:35.895052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:35.903238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9afbfda3-3afd-42d7-af35-223a7c69a239 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150011 Sep 19 15:41:35.903799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 978/2062] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:35 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:36.930463 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:36.931024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:36.937602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:36.938077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:36.938526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:36.939188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:36.939665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:36.940081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:37.077860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:37.086767 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f1209e95-d30e-4536-bd06-d440dc7adfc7 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.160222 Sep 19 15:41:37.088508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1085/2063] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:36 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:38.110454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:38.111064 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:38.116934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:38.117422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:38.117924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:38.118553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:38.119007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:38.119430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:38.273709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:38.282682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6438aadd-5c0b-4d94-83f1-29b07e10fe14 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.176112 Sep 19 15:41:38.283275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 979/2064] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:38 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:39.305813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:39.306461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:39.308786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=26 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:39.313422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:39.313899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:39.314330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:39.315018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:39.315520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:39.315937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:39.443764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:39.452586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4dc5eff3-1276-44b3-98ad-02ea2a8329b8 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150612 Sep 19 15:41:39.453148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1086/2065] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:39 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:40.477043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:40.477691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:40.480235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=26 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:40.485589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:40.486072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:40.486503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:40.487195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:40.487651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:40.488068 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:40.622063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:40.630263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-20a07d48-9541-403e-8c48-dde134c2eea6 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157573 Sep 19 15:41:40.630850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 980/2066] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:40 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:41.654055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:41.654675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:41.661182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:41.661664 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:41.662101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:41.662796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:41.663250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:41.663677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:41.793836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:41.802457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ba38ae53-25b3-4497-b0cc-cbdf25b230e5 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152691 Sep 19 15:41:41.803011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1087/2067] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:41 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:42.826312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:42.827033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:42.833558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:42.833978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:42.834407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:42.835089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:42.835540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:42.835959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:42.971235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:42.979443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4b54ffb8-0afd-4dd5-8ac9-27d2b13ddb2a tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.157636 Sep 19 15:41:42.980000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 981/2068] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:42 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:44.004250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:44.004953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:44.011299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:44.011780 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:44.012210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:44.012927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:44.013552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:44.014137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:44.140946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:44.149060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c54c7661-ecfc-4895-a523-5289a6902b0c tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.148705 Sep 19 15:41:44.149616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1088/2069] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:43 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:45.173581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:45.174183 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:45.180538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:45.181016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:45.181442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:45.182128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:45.182576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:45.182992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:45.313236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:45.321252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-003f2ded-067f-44f7-9953-c35f1b789f75 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.152351 Sep 19 15:41:45.321806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 982/2070] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:45 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:46.344394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:46.345058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:46.351408 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:46.351884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:46.352311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:46.353012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:46.353458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:46.353873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:46.487203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:46.495430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-09087e90-c1e1-4ab8-9b9e-b17f9e437920 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.155077 Sep 19 15:41:46.495994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1089/2071] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:46 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:47.518795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:47.519350 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:47.525677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:47.526153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:47.526583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:47.527264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:47.527733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:47.528148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:47.530910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=78 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:47.656133 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:47.664914 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c83fe394-3380-484e-be7a-abfa3e7f25c1 tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.150407 Sep 19 15:41:47.665634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 983/2072] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:47 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:48.688109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:48.688831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:48.696006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:48.696506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:48.696959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:48.697871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:48.698091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:48.698513 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:48.702438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=78 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:41:48.839161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:48.848520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c053ef77-29b6-4666-a03d-403f263b892f tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.164180 Sep 19 15:41:48.849091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1090/2073] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:48 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:49.797792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:49.798352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:49.805103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:49.805588 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:49.806022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:49.806729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:49.807210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:49.807641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:49.834165 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:41:49.872950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:49.873569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] [instance: ed221b61-f2e4-4a1c-88db-8ee956c45e7a] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:49.880773 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:49.881288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:49.881723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:49.882436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:49.882876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:49.883302 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.025294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4ee04a6c6d42fd9bc97d5e356d4a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bbde55bafa42108676212642d7d3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:50.033556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f8a6ebc7-558a-4ffa-8d99-6702d85ffccd tempest-VolumesSnapshotTestJSON-74002691 tempest-VolumesSnapshotTestJSON-74002691-project] 10.222.0.75 "GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a" status: 200 len: 1558 microversion: 2.1 time: 0.164964 Sep 19 15:41:50.034828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1091/2074] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:49 2022] GET /compute/v2.1/servers/ed221b61-f2e4-4a1c-88db-8ee956c45e7a => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:41:50.185157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0fb0bf59-dddb-4952-89fb-aee93e739618 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 204 len: 0 microversion: 2.1 time: 0.390928 Sep 19 15:41:50.185811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 984/2075] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:41:49 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:41:50.194176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:50.195895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:50.200703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.201212 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.201601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.202288 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:50.202926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:50.203348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:50.334444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:50.342546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4d9263d1-8474-4afc-a623-0bc32548828e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1728 microversion: 2.1 time: 0.152324 Sep 19 15:41:50.343106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1092/2076] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:51.367072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:51.374444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:51.374821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:51.375422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:51.375863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:51.376635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:51.377090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:51.377521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:51.839312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:51.847718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c23c6eba-a4f0-438c-b6ed-3006c4bb52d2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1728 microversion: 2.1 time: 0.484866 Sep 19 15:41:51.848282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 985/2077] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1728 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:41:52.507243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-5861b7f9-a81e-45c9-a276-268634db9221 req-dca4b8ad-7895-4169-8c50-8ca94b824116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2751262b-7323-4c6a-b3f1-830fb2448558", "name": "network-vif-deleted", "tag": "f872e19c-541e-4edf-b7d4-a8a9c1d84150"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:41:52.517886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5861b7f9-a81e-45c9-a276-268634db9221 req-dca4b8ad-7895-4169-8c50-8ca94b824116 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:52.518546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5861b7f9-a81e-45c9-a276-268634db9221 req-dca4b8ad-7895-4169-8c50-8ca94b824116 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:52.519385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-5861b7f9-a81e-45c9-a276-268634db9221 req-dca4b8ad-7895-4169-8c50-8ca94b824116 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:52.531013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-5861b7f9-a81e-45c9-a276-268634db9221 req-dca4b8ad-7895-4169-8c50-8ca94b824116 service nova] Creating event network-vif-deleted:f872e19c-541e-4edf-b7d4-a8a9c1d84150 for instance 2751262b-7323-4c6a-b3f1-830fb2448558 on hv-cinder-75671 Sep 19 15:41:52.536946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-5861b7f9-a81e-45c9-a276-268634db9221 req-dca4b8ad-7895-4169-8c50-8ca94b824116 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033595 Sep 19 15:41:52.537962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1093/2078] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:41:52.871597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:52.872428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:52.880334 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:52.880859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:52.881329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:52.882033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:52.882488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:52.882918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:52.945007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:52.953173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7e1e672e-6821-4c39-aae9-22bae0cbeb3a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085913 Sep 19 15:41:52.953738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 986/2079] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:53.978136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:53.978845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:53.984990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:53.985474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:53.985911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:53.986601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:53.987649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:53.988081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:54.051726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:54.059953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9413f795-af79-4da7-bf91-68c0b0d094d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086635 Sep 19 15:41:54.060533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1094/2080] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:55.082955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:55.083566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:55.090005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:55.090491 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:55.090930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:55.091630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:55.092085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:55.092541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:55.155124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:55.163539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-02d2beab-735a-4734-a13f-aafcd23486dd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084623 Sep 19 15:41:55.164103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 987/2081] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:56.185946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:56.186550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:56.193536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:56.194008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:56.194438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:56.195109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:56.195560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:56.195969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:56.257304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:56.265293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d9b8d718-2448-4c52-b38d-32bbe3b4aba6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083226 Sep 19 15:41:56.265841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1095/2082] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:57.288440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:57.289081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:57.295506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:57.295987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:57.296427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:57.297152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:57.297608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:57.298039 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:57.360544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:57.369164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-04dc03d1-caab-4ce3-b56d-2fe39df690a1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084785 Sep 19 15:41:57.369731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 988/2083] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:58.392805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:58.394050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:58.400416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:58.400928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:58.401360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:58.402055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:58.402504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:58.402926 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:58.464328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:58.472763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c7613b76-ec0c-4b5d-b78c-9b5cbe03b0c3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083851 Sep 19 15:41:58.473315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1096/2084] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:41:59.495194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:41:59.495794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:41:59.502414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:59.502897 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:59.503336 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:59.505114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:41:59.505786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:41:59.506227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:41:59.572728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:41:59.581012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-55c92c9e-4bb5-49b1-8991-ccae57714c05 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089741 Sep 19 15:41:59.581570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 989/2085] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:41:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:00.604248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:00.604893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:00.611672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:00.612159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:00.612622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:00.613347 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:00.614137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:00.614579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:00.675793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:00.683888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-df3aa46d-f377-478b-9514-d0d14c296a96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083533 Sep 19 15:42:00.684449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1097/2086] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:01.707302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:01.707950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:01.715145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:01.715631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:01.716070 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:01.716793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:01.717246 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:01.717667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:01.779125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:01.787538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-344edb24-450c-4be2-948e-754627d50c3f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083366 Sep 19 15:42:01.788109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 990/2087] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:02.809667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:02.810275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:02.816817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:02.817294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:02.817729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:02.818414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:02.818861 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:02.819278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:02.882784 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:02.890925 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-003008e0-4c14-4aa8-8933-73eb1eaa7e4a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085138 Sep 19 15:42:02.891481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1098/2088] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:03.914710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:03.915321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:03.921989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:03.922485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:03.922928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:03.923682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:03.924168 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:03.924628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:03.989924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:03.998460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-baf8e503-9604-49c5-85b4-05c87de12ab6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088138 Sep 19 15:42:03.999020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 991/2089] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:05.022679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:05.023270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:05.029675 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:05.030092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:05.030520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:05.031200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:05.031644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:05.032059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:05.097035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:05.105665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e4d5957a-34c6-4047-a482-b54e9dc1dc3e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087559 Sep 19 15:42:05.106220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1099/2090] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:06.128021 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:06.128671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:06.135092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:06.135568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:06.136005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:06.136728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:06.137184 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:06.137606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:06.198988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:06.207029 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9b6352de-c5c0-42b1-b878-6404e0c5e934 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082903 Sep 19 15:42:06.207587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 992/2091] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:07.230993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:07.231609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:07.237649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:07.238131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:07.238563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:07.239247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:07.240607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:07.240913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:07.301250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:07.311905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-94af70c2-7675-44ac-b445-a298fbaddc24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084895 Sep 19 15:42:07.312500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1100/2092] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:08.335411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:08.336030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:08.342458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:08.342940 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:08.343377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:08.344082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:08.344566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:08.344995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:08.408579 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:08.417551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e6750387-1aa1-466f-9555-6a54354ec7a2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086595 Sep 19 15:42:08.418114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 993/2093] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:09.440561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:09.441173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:09.443799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=30 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:09.448501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:09.448987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:09.449423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:09.450109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:09.450562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:09.450986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:09.513292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:09.521175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d45342c1-e905-4cfa-8ed3-c515322d1407 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084511 Sep 19 15:42:09.521743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1101/2094] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:10.544589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:10.545223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:10.551585 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:10.552699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:10.553128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:10.553811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:10.554257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:10.554677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:10.615366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:10.623814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f9baeda0-006e-4341-8689-06ac71be9ad4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083098 Sep 19 15:42:10.624376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 994/2095] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:11.647402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:11.648012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:11.654568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:11.655040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:11.655472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:11.656154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:11.656629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:11.657062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:11.718967 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:11.727862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-72ab58e2-a0b7-451b-bbf9-3cea78195985 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084503 Sep 19 15:42:11.728418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1102/2096] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:12.751415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:12.752031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:12.755498 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:12.760342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:12.764607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:12.764607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:12.764607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:12.764607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:12.764963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:12.829764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:12.838100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b74b04ac-b79d-4ee3-84f9-2735e3d05337 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.090849 Sep 19 15:42:12.838676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 995/2097] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:13.861114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:13.861771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:13.868567 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:13.869050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:13.869486 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:13.870170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:13.870620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:13.871114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:13.932580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:13.940671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f1c1e10-1b97-4d34-b1d2-10958967c02b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083406 Sep 19 15:42:13.941224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1103/2098] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:14.964785 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:14.965411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:14.971879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:14.972368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:14.972835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:14.973560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:14.974210 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:14.974738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:15.035397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:15.043582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b8b8f1a4-34d7-4526-bdee-3a8f7b193879 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082814 Sep 19 15:42:15.044151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 996/2099] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:16.070576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:16.071554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:16.079637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:16.080113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:16.080651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:16.081352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:16.081804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:16.082227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:16.151221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:16.159836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3cc37557-d70c-4016-983d-7782ecb1bb4c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.093217 Sep 19 15:42:16.160454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1104/2100] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:17.184076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:17.184727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:17.191170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:17.191646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:17.192080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:17.193035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:17.193489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:17.193915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:17.258720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:17.266894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b5cae167-80c3-4899-98f8-27fc086feb28 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086837 Sep 19 15:42:17.267457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 997/2101] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:18.289265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:18.289860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:18.296410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:18.296927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:18.297361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:18.298050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:18.298498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:18.298919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:18.362356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:18.371044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6c783cf2-ebf9-4ac1-b5ca-e535e922398a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085649 Sep 19 15:42:18.371601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1105/2102] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:19.394270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:19.394909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:19.401765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:19.402237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:19.402668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:19.403353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:19.403800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:19.404236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:19.406726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:19.466767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:19.474896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8b1fc31d-c2d3-4d26-8c95-61d9c3135091 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084475 Sep 19 15:42:19.475508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 998/2103] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:20.498569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:20.499200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:20.505608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:20.506091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:20.506526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:20.507898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:20.508356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:20.508816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:20.512677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=92 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:20.570335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:20.578958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ab897399-5583-4fd1-85b9-74e7bde031c2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084598 Sep 19 15:42:20.579519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1106/2104] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:21.602036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:21.602656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:21.609543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:21.610075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:21.610519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:21.611217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:21.611690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:21.612106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:21.678245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:21.687506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2a6e1c6-dfc6-4e0a-adf0-307a869c881d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089845 Sep 19 15:42:21.688087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 999/2105] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:22.712731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:22.713368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:22.722094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:22.722574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:22.723005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:22.723696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:22.724143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:22.724596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:22.790101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:22.798323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e6e51388-92ba-44bf-b570-69e886476988 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.090033 Sep 19 15:42:22.798881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1107/2106] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:23.821619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:23.822237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:23.828805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:23.829388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:23.829827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:23.830524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:23.830985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:23.831413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:23.893000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:23.901090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a6c34c23-e262-48b2-9d8e-07f7692837f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083844 Sep 19 15:42:23.901651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1000/2107] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:24.924095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:24.924741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:24.931680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:24.932151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:24.932652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:24.933332 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:24.933777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:24.934195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:24.995891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:25.004354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a6ed5d60-47e4-4d3a-874f-2852764d6c52 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084143 Sep 19 15:42:25.004946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1108/2108] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:26.029238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:26.029795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:26.036290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:26.036815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:26.037261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:26.037955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:26.038414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:26.038905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:26.103918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:26.112006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d6c51526-7407-44ba-9710-ab17c273c03a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086732 Sep 19 15:42:26.112620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1001/2109] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:27.135765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:27.136372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:27.142851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:27.143335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:27.143775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:27.144466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:27.144944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:27.145370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:27.210159 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:27.218988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8d64950-8569-48b1-9f8f-bf586cb1e63e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087140 Sep 19 15:42:27.219547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1109/2110] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:28.240843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:28.241450 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:28.248758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:28.249250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:28.249685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:28.250388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:28.250846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:28.251273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:28.312213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:28.320406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8aba1e66-7ea8-4a00-9797-98a71f5d0039 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083493 Sep 19 15:42:28.321054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1002/2111] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:29.343641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:29.344259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:29.346273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:42:29.346425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 (ip 10.222.0.75) !!! Sep 19 15:42:29.348294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:42:29.348423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 (ip 10.222.0.75) !!! Sep 19 15:42:29.360180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:29.360700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:29.361140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:29.361837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:29.362290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:29.362713 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:29.425659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:29.433998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-28179fe7-39ab-49e8-a6fd-8db92bd45894 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.094586 Sep 19 15:42:29.434568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1110/2112] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:42:30.456915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:30.457526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:30.464209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:30.464728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:30.465171 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:30.465868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:30.466343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:30.466751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:30.534487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:30.543573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0695d36e-931c-41da-8565-09697c09d096 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.090569 Sep 19 15:42:30.544139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1003/2113] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:31.567105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:31.567752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:31.574872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:31.575352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:31.575782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:31.576469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:31.576947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:31.577370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:31.643000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:31.652619 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4addd9ac-02c9-4b6e-8241-b839eeef6ed6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089339 Sep 19 15:42:31.653197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1111/2114] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:32.675462 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:32.676046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:32.677954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:42:32.678094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 (ip 10.222.0.75) !!! Sep 19 15:42:32.679241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:42:32.679363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 (ip 10.222.0.75) !!! Sep 19 15:42:32.687341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:32.687826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:32.688263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:32.688998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:32.689452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:32.689874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:32.751554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:32.760508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9204ceeb-a30a-4927-8e30-6f56e90c0f78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089038 Sep 19 15:42:32.761071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1004/2115] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:33.785293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:33.785904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:33.793410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:33.793883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:33.794311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:33.794993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:33.795436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:33.795847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:33.867458 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:33.876152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2cf03ff2-41ef-433c-9156-fb2d1c4fc3de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.096196 Sep 19 15:42:33.876742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1112/2116] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:34.898447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:34.899100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:34.905630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:34.906106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:34.906532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:34.907221 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:34.907666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:34.908081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:34.970959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:34.979554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-34f64a69-cf59-4aeb-927b-01c042eb5d24 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085102 Sep 19 15:42:34.980110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1005/2117] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:36.002944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:36.003562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:36.010731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:36.011216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:36.011654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:36.012351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:36.012830 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:36.013265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:36.074883 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:36.083046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6f473395-8eaf-4403-bc6b-c3ba2fbdaefd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083974 Sep 19 15:42:36.083611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1113/2118] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:37.108740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:37.109400 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:37.115541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:37.116033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:37.116523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:37.117237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:37.117743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:37.118327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:37.184223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:37.192420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6dc33e54-772b-4e01-91e8-3ed523b2ea96 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089319 Sep 19 15:42:37.193016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1006/2119] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:38.218571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:38.219166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:38.225355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:38.225834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:38.226275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:38.227578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:38.228133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:38.228596 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:38.288867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:38.297586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-71601e21-785a-44a7-bd70-7581ea9f0556 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082945 Sep 19 15:42:38.298164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1114/2120] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:39.320259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:39.320907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:39.327318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:39.327802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:39.328240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:39.328999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:39.329457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:39.329889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:39.393930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:39.402006 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4064c1f0-07d5-4a5a-9775-5d1717525a0d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085669 Sep 19 15:42:39.402572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1007/2121] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:40.425208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:40.425816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:40.428074 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=28 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:40.433429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:40.437573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:40.437573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:40.437573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:40.437573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:40.438053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:40.498616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:40.506721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-99d7e6a9-8c23-4fc5-9222-06089ecfc67b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085330 Sep 19 15:42:40.507278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1115/2122] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:42:41.530235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:41.530778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:41.537239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:41.537715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:41.538143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:41.538827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:41.539324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:41.539808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:41.603362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:41.611519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-364d7e20-a7e9-4050-90e0-027e71452e1e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085264 Sep 19 15:42:41.612076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1008/2123] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:42.633843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:42.634466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:42.641511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:42.642015 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:42.642471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:42.643157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:42.643603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:42.644017 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:42.705191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:42.713752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2fcd55ce-a5dc-4c76-be72-c8c16e98cad1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083816 Sep 19 15:42:42.714311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1116/2124] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:43.737197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:43.737848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:43.740595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=28 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:43.746206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:43.746694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:43.747386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:43.748163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:43.748681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:43.749128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:43.814777 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:43.822923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-52a400ce-f05a-4563-a467-568da10353ff tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089665 Sep 19 15:42:43.823496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1009/2125] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:44.846006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:44.846611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:44.853532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:44.854012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:44.854440 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:44.855122 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:44.855571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:44.855987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:44.917859 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:44.925907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ce92c41f-0933-41aa-b5ae-535847f40eae tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083733 Sep 19 15:42:44.926468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1117/2126] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:45.950214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:45.950826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:45.957358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:45.957847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:45.958284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:45.958980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:45.959439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:45.959869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:46.020341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:46.029298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-51defb8f-7281-4f61-9d3c-f4035d1ece2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083476 Sep 19 15:42:46.029804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1010/2127] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:47.052147 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:47.052790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:47.060071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:47.060598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:47.061033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:47.061715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:47.062162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:47.062588 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:47.126442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:47.134940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c8cca2d2-0ff1-4a58-866f-37f3c28c3bf4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086755 Sep 19 15:42:47.135507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1118/2128] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:48.157639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:48.158256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:48.164782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:48.165403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:48.165965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:48.166674 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:48.167134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:48.167562 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:48.231127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:48.239185 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bbd883be-0127-4628-abb4-9da3731e5195 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085441 Sep 19 15:42:48.239746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1011/2129] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:49.263822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:49.264454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:49.271039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:49.271511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:49.271934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:49.272647 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:49.273104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:49.273514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:49.336473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:49.344879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f23cef0a-df62-46dc-a32d-c56e86acc9de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084903 Sep 19 15:42:49.345443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1119/2130] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:50.368586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:50.369206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:50.375755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:50.376230 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:50.376688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:50.377371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:50.377824 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:50.378239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:50.439148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:50.448126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8b11f42f-3fe2-4213-bff5-a23c201f4fc2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083915 Sep 19 15:42:50.448727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1012/2131] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:51.471929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:51.472522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:51.479696 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:51.480181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:51.480655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:51.481355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:51.481831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:51.482238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:51.544641 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:51.552971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8cca41c0-77ca-4345-a591-ff19756ab319 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085230 Sep 19 15:42:51.553540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1120/2132] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:52.577317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:52.577965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:52.584357 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:52.584893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:52.585326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:52.586008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:52.586457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:52.587146 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:52.591063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=90 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:52.651156 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:52.659936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-323fe1f0-693b-4d39-8469-3f7529916dc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086615 Sep 19 15:42:52.660533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1013/2133] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:53.683115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:53.683718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:53.690129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.690602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.691029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.691703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:53.692150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:53.692601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:53.697019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=90 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:42:53.754342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:53.762980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-646600a7-7d41-4ee3-a807-13b464352add tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083764 Sep 19 15:42:53.763533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1121/2134] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:54.786467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:54.787079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:54.793875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:54.794353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:54.794782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:54.795466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:54.796190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:54.796646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:54.859408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:54.867494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e2b6d104-ffc8-4a57-9575-ad892c43c478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084871 Sep 19 15:42:54.868061 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1014/2135] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:55.892203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:55.892846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:55.899403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:55.899884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:55.900326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:55.901722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:55.902175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:55.902603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:55.963251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:55.972889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1f7d0440-e5d2-482b-94a8-7191bb3858f1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084477 Sep 19 15:42:55.973449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1122/2136] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:56.996127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:56.996767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:57.003464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:57.003946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:57.004384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:57.005105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:57.005557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:57.005985 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:57.069861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:57.078816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-86b0c9c5-c1ba-4bc4-801b-26a195e92917 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087463 Sep 19 15:42:57.083257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1015/2137] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:58.101475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:58.102093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:58.109096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:58.109575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:58.110009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:58.110699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:58.111151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:58.111573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:58.172872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:58.180964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-05fe7682-43c4-4a2f-bc0e-77dd87a90c5e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083414 Sep 19 15:42:58.181525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1123/2138] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:42:59.204577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:42:59.205199 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:42:59.211583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:59.212086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:59.212532 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:59.213740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:42:59.214201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:42:59.214632 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:42:59.278653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:42:59.288700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b0b8e7e-58be-4aaf-8402-26b4caa2ab9c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087965 Sep 19 15:42:59.289274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1016/2139] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:42:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:00.313600 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:00.314199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:00.320716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:00.321201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:00.321636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:00.322324 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:00.322819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:00.323242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:00.384617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:00.393175 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3c440b05-2b7d-4949-908e-c09477038ede tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083418 Sep 19 15:43:00.393749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1124/2140] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:01.416681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:01.417510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:01.423876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:01.424388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:01.424851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:01.425544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:01.426003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:01.426427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:01.490028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:01.499388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a6f49d98-e781-4983-8527-24c5c83d4fe4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086682 Sep 19 15:43:01.499960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1017/2141] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:02.522470 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:02.523162 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:02.529820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:02.530350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:02.530789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:02.531557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:02.532034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:02.532566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:02.595712 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:02.604151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5ac5c081-2a96-4607-bf1e-4da09a3702e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085422 Sep 19 15:43:02.605366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1125/2142] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:03.628991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:03.629603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:03.636027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:03.636535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:03.637676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:03.638386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:03.638846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:03.639272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:03.698954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:03.707732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7f5c02f9-ed6b-4aae-b94f-596c49832d72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082667 Sep 19 15:43:03.708296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1018/2143] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:04.730544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:04.731124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:04.737462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:04.737935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:04.738363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:04.739044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:04.739488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:04.739906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:04.802093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:04.810387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e80245f0-8c70-423b-aadb-36a6ebc9efc7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083819 Sep 19 15:43:04.810941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1126/2144] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:05.834590 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:05.835198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:05.842054 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:05.842529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:05.842958 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:05.843637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:05.844083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:05.844512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:05.907618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:05.915907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a490fe1b-cbed-42ba-9581-963525fee9af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085174 Sep 19 15:43:05.916489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1019/2145] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:06.940542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:06.941180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:06.947238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:06.947720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:06.948155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:06.948872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:06.949350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:06.949886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:07.010376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:07.018612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c3696e82-4a8f-46e4-916d-d8356f44087b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082161 Sep 19 15:43:07.019169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1127/2146] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:08.041798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:08.042372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:08.051909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:08.052399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:08.052966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:08.054274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:08.055038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:08.055524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:08.116469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:08.125526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7eeb2844-4ab8-4650-837d-94e4e4888efb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087962 Sep 19 15:43:08.126085 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1020/2147] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:08 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:09.149362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:09.150016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:09.157083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:09.157558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:09.157994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:09.158666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:09.159111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:09.159525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:09.219930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:09.227962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ce195592-df6b-4184-9baf-b916a6718cf7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082596 Sep 19 15:43:09.228530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1128/2148] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:10.250589 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:10.251219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:10.257762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:10.258248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:10.258682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:10.259376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:10.259831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:10.260258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:10.326487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:10.334805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-07759467-716d-412f-908d-ddfaf00418af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088711 Sep 19 15:43:10.335369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1021/2149] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:11.149173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:11.149718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:11.156225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:11.157136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:11.157568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.158262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:11.158709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:11.159124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.188047 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:43:11.359314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:11.359923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:11.366256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:11.366731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:11.367161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.368033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:11.369016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:11.369545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.433540 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:11.442642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-619f75f6-858b-4ec1-a8a3-d88ff753af2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087728 Sep 19 15:43:11.446508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1022/2150] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:11.605897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6de9fde0-280a-45c9-96dc-de11e543e2f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 204 len: 0 microversion: 2.1 time: 0.459632 Sep 19 15:43:11.606494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1129/2151] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:43:11 2022] DELETE /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:43:11.614933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:11.615738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:11.622615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:11.623095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:11.623523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.624249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:11.624724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:11.625143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:11.756056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:11.763784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-32474022-1fd8-4350-9388-914617c895d9 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1507 microversion: 2.1 time: 0.153174 Sep 19 15:43:11.764338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1023/2152] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:11 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.466707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:12.467494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.473971 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.474457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.474894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.475589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.476041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.476464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.575310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:12.583828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-16596ce4-bdd5-4025-a90a-a21b6c195db2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.122086 Sep 19 15:43:12.584404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1130/2153] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:12.787232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:12.787876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:12.795108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.795599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.796037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:12.796770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:12.797228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:12.797654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.110971 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:13.118638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-be2da926-0a91-4d59-b4e5-f58cbbb2566f tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1507 microversion: 2.1 time: 0.335290 Sep 19 15:43:13.119208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1024/2154] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:12 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:13.609255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:13.609881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:13.612386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:13.619042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:13.619802 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:13.620409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.622102 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:13.623029 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:13.623628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.709866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:13.718613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b7f7e44b-af9b-46e4-a696-2e1c9520829f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.115183 Sep 19 15:43:13.719901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1131/2155] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:13.753181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-96a4406c-d5a5-4105-8486-a05725b8173b req-a474e87e-9fa0-43ec-972a-6d01e6f1de5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76", "name": "network-vif-deleted", "tag": "21cce671-3b51-418b-84fa-c3068a42f75e"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:13.763324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-96a4406c-d5a5-4105-8486-a05725b8173b req-a474e87e-9fa0-43ec-972a-6d01e6f1de5d service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:13.767200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-96a4406c-d5a5-4105-8486-a05725b8173b req-a474e87e-9fa0-43ec-972a-6d01e6f1de5d service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:13.767200 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-96a4406c-d5a5-4105-8486-a05725b8173b req-a474e87e-9fa0-43ec-972a-6d01e6f1de5d service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:13.775598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-96a4406c-d5a5-4105-8486-a05725b8173b req-a474e87e-9fa0-43ec-972a-6d01e6f1de5d service nova] Creating event network-vif-deleted:21cce671-3b51-418b-84fa-c3068a42f75e for instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 on hv-cinder-75671 Sep 19 15:43:13.781348 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-96a4406c-d5a5-4105-8486-a05725b8173b req-a474e87e-9fa0-43ec-972a-6d01e6f1de5d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Sep 19 15:43:13.782161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1025/2156] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:43:14.142492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:14.143138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:14.149266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.149751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.150189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.150877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.151336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.151758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.184044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.184565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.185000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.185700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lazy-loading 'fault' on Instance uuid f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:43:14.227221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:14.238006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b075eab4-0a4d-4b4b-befc-d7a86b6bf6f2 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 200 len: 1311 microversion: 2.1 time: 0.097466 Sep 19 15:43:14.238006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1132/2157] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:14 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:14.743842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:14.744575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:14.746561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=34 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:14.751710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.752327 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.752734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.753466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:14.753920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:14.754352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:14.821790 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:14.830044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d1a1a8c9-533b-402a-81ea-15be6342633d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.091001 Sep 19 15:43:14.830608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1026/2158] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:15.259640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:15.260255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:15.267516 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.268130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.268629 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.269841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.269841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.270205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.285110 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 could not be found. Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 HTTP/1.1 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:43:15.286779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 could not be found. Sep 19 15:43:15.288643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76'} Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 could not be found. Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:43:15.289775 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 could not be found. Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 could not be found. Sep 19 15:43:15.291263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:15.293464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:43:15.293464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fb86d759-88c9-42e9-afc5-c686061e5376 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76" status: 404 len: 111 microversion: 2.1 time: 0.032514 Sep 19 15:43:15.293464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1133/2159] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:15 2022] GET /compute/v2.1/servers/f302dcd8-ebdc-44b9-aa7a-b5da5bbbba76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:43:15.296831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:15.297341 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:15.303321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.303807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.304247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.304979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.305439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.305869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.331274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:43:15.599521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4e3161a0-3028-4958-a566-c571a5fc0edb tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 204 len: 0 microversion: 2.1 time: 0.306208 Sep 19 15:43:15.600214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1027/2160] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:43:15 2022] DELETE /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:43:15.608721 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:15.610090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:15.616345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.616835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.617263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.617949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.618393 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.618809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.770301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:15.779818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7003ef70-d94b-4f2d-aa6a-2ac83aa779cc tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.174873 Sep 19 15:43:15.780601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1134/2161] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:15 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:15.854850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:15.856057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:15.863227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.863699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.864943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.864943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:15.865293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:15.865715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:15.937402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:15.939754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:15.946909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3ce4b56-6bb9-48e1-b0d3-310d4df06620 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.096470 Sep 19 15:43:15.947477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1028/2162] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:16.809613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:16.810233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:16.816731 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:16.817267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:16.817645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:16.818341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:16.818794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:16.819223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:16.962142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:16.971990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:16.972729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:16.983087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ac36d05a-5fc5-4b7f-8843-5317a2628f8e tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1522 microversion: 2.1 time: 0.177613 Sep 19 15:43:16.985459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1135/2163] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:16 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:16.997795 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:16.998295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:16.998797 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:16.999712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:17.000526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:17.001753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:17.057916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-86f45748-4b89-49cd-b296-80d97de3369c req-25e51f18-94f9-4584-860b-d53680af1a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0ce04e-f5c6-42b8-bbac-8ab27d3df274", "name": "network-vif-deleted", "tag": "3877f386-6e61-4be6-9038-2805e12927a6"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:43:17.069351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-86f45748-4b89-49cd-b296-80d97de3369c req-25e51f18-94f9-4584-860b-d53680af1a95 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:17.069849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-86f45748-4b89-49cd-b296-80d97de3369c req-25e51f18-94f9-4584-860b-d53680af1a95 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:17.070277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-86f45748-4b89-49cd-b296-80d97de3369c req-25e51f18-94f9-4584-860b-d53680af1a95 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:17.082801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-86f45748-4b89-49cd-b296-80d97de3369c req-25e51f18-94f9-4584-860b-d53680af1a95 service nova] Creating event network-vif-deleted:3877f386-6e61-4be6-9038-2805e12927a6 for instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 on hv-cinder-75671 Sep 19 15:43:17.084272 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:17.087850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-86f45748-4b89-49cd-b296-80d97de3369c req-25e51f18-94f9-4584-860b-d53680af1a95 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034267 Sep 19 15:43:17.088887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1136/2164] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:43:17.093727 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-61beaf28-ce1a-4b9d-b573-e0a2b9e54bc8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.125928 Sep 19 15:43:17.094468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1029/2165] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:18.008634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:18.009958 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:18.016704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:18.017254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:18.017697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:18.018402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:18.018864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:18.019286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:18.023935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:18.056240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:18.056983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:18.057598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:18.058228 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lazy-loading 'fault' on Instance uuid ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:43:18.100678 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338bde3096e44d81b2157690c75bfa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677200be9d434857877c452db7ad4b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:18.109105 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2b0992d0-0890-40f5-a3e0-7a397e835f36 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 200 len: 1312 microversion: 2.1 time: 0.105935 Sep 19 15:43:18.109679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1137/2166] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:18 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:18.116745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:18.117366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:18.124786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:18.125275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:18.125757 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:18.126490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:18.126945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:18.127373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:18.195661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:18.204252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e7e20b26-fe1b-467f-8581-bb51a2288041 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.091922 Sep 19 15:43:18.204954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1030/2167] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:19.131889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:19.132538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] [instance: ee0ce04e-f5c6-42b8-bbac-8ab27d3df274] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:19.140222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:19.140738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:19.141181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:19.141869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:19.142320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:19.142746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:19.156559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] HTTP exception thrown: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 could not be found. Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Request method failure captured: Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 HTTP/1.1 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIayO7o-yG5shBTkwHcdc5ZcMbcD9K3dor4oYyBSmqBHgAPOhWxhPpVEhlFmzZzwF_KFjWGnptVO32vinL6E7mqMyIwB25IJzAJCrPb2DPi5vfnjPE7AuM94-Gm0TWRjEPTmwWkpGO2fPM7N8G5YGlB3ykuWhiHh2XxlTkE7IFNxlE4 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:43:19.158222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/677200be9d434857877c452db7ad4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/677200be9d434857877c452db7ad4b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_677200be9d434857877c452db7ad4b20"}]}] Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 677200be9d434857877c452db7ad4b20 Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132154922 Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 338bde3096e44d81b2157690c75bfa05 Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132154922-project Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 could not be found. Sep 19 15:43:19.160090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'ee0ce04e-f5c6-42b8-bbac-8ab27d3df274'} Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 could not be found. Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:43:19.161321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 could not be found. Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 could not be found. Sep 19 15:43:19.163146 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:43:19.164964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] Returning 404 to user: Instance ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:43:19.164964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-73ef0c80-2c04-4150-8697-04226ebf0b24 tempest-ServerRescueNegativeTestJSON-2132154922 tempest-ServerRescueNegativeTestJSON-2132154922-project] 10.222.0.75 "GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274" status: 404 len: 111 microversion: 2.1 time: 0.031651 Sep 19 15:43:19.164964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1138/2168] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:19 2022] GET /compute/v2.1/servers/ee0ce04e-f5c6-42b8-bbac-8ab27d3df274 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:43:19.229268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:19.230016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:19.237932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:19.238411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:19.238988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:19.239828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:19.240445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:19.241147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:19.316655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:19.325827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0edc9e6c-7e95-403c-842c-a020db2a6212 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.101671 Sep 19 15:43:19.326403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1031/2169] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:20.349457 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:20.350077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:20.358060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:20.358550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:20.359021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:20.359720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:20.360171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:20.360636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:20.430603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:20.442480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-989b5f58-76d4-4593-9509-f640c2b4a78d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.096762 Sep 19 15:43:20.448684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1139/2170] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:21.472082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:21.472925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:21.481751 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:21.482354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:21.482911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:21.483713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:21.484278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:21.484849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:21.552748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:21.562440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33c50532-30c4-4dbd-9373-d2c21c964592 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.094458 Sep 19 15:43:21.563164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1032/2171] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:22.588077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:22.589438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:22.597401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:22.597887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:22.598363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:22.599040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:22.599492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:22.599918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:22.678526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:22.689697 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c2f08bbe-57fe-4f17-9f87-cf2ef1d07ca9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.107396 Sep 19 15:43:22.690281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1140/2172] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:23.714100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:23.714648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:23.721581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:23.722063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:23.722493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:23.723178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:23.723626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:23.724046 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:23.787793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:23.796846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-df323b76-c347-4e79-94a5-8a4f7a799a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086634 Sep 19 15:43:23.797413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1033/2173] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:24.819261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:24.819920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:24.827164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:24.827648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:24.828090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:24.828885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:24.829433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:24.829873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:24.904198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:24.913498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c6f5b935-2516-42db-9c24-bded588ed9ee tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.098111 Sep 19 15:43:24.914527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1141/2174] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:25.938665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:25.939275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:25.945661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:25.946162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:25.946598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:25.947278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:25.947721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:25.948141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:26.011858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:26.020275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8944804b-937d-4fd6-a823-9c554fe7b99b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086199 Sep 19 15:43:26.020865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1034/2175] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:43:27.043306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:27.043985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:27.050621 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:27.053343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:27.053343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:27.053343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:27.053343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:27.053747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:27.114566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:27.123519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d7a880ad-60ae-4c51-923e-d98f480b3d94 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084219 Sep 19 15:43:27.124075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1142/2176] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:28.146135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:28.146755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:28.153352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:28.153837 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:28.154304 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:28.154998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:28.155454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:28.155884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:28.224472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:28.233376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2064c943-2714-4434-b8e2-36427983265c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.091096 Sep 19 15:43:28.233942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1035/2177] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:29.255497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:29.256140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:29.263213 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:29.263756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:29.264194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:29.264908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:29.265360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:29.265783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:29.327168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:29.335323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-61f05b22-cc99-4431-ad93-b34617601fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083694 Sep 19 15:43:29.335877 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1143/2178] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:30.359066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:30.359666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:30.366119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:30.366606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:30.367043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:30.367741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:30.368194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:30.368655 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:30.432859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:30.441263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-325e84da-110c-4567-b4eb-e2e8bc0c5a6f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086418 Sep 19 15:43:30.441827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1036/2179] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:31.466127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:31.466726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:31.473226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:31.473704 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:31.474141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:31.474827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:31.475276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:31.475698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:31.536851 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:31.546044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dd0a2fcc-1888-4453-a694-56b9b6f14daa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084560 Sep 19 15:43:31.546608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1144/2180] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:32.569278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:32.569891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:32.577262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:32.577772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:32.578262 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:32.579019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:32.579438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:32.579864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:32.645186 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:32.654276 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f14f7cf8-68dd-4fe4-8a0b-4edb27acbf08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088848 Sep 19 15:43:32.654825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1037/2181] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:33.677787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:33.678401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:33.684988 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:33.685459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:33.685886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:33.686561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:33.687005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:33.687419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:33.748449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:33.756674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d53907f6-7a13-4dea-9d35-97c581e9b034 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082750 Sep 19 15:43:33.757236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1145/2182] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:34.779809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:34.780421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:34.786812 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:34.787283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:34.787713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:34.788398 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:34.788881 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:34.789302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:34.849687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:34.858313 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b924e30a-608c-4438-89cd-7b8751558134 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082403 Sep 19 15:43:34.858864 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1038/2183] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:35.881876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:35.882409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:35.888814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:35.889287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:35.889714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:35.890387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:35.890829 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:35.891244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:35.953795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:35.962024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3cefd8c4-06c6-4f55-af6f-31adecea58de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084133 Sep 19 15:43:35.962580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1146/2184] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:36.986153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:36.986883 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:36.993671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:36.994278 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:36.994831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:36.995874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:36.997650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:36.998237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:37.069566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:37.078205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5052b90d-b208-40ad-b024-fe2b9cab92e7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.095999 Sep 19 15:43:37.078805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1039/2185] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:38.101180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:38.101796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:38.108465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:38.108973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:38.109410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:38.110101 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:38.110552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:38.110978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:38.172229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:38.180270 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f64aa16e-31e5-47ad-b389-4a910b1ca2ce tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083147 Sep 19 15:43:38.180849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1147/2186] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:39.203279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:39.203933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:39.210468 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:39.210959 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:39.211399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:39.212097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:39.212582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:39.213013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:39.273676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:39.282175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a15e554f-d910-45f1-8730-b26cfcd2d9d6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082837 Sep 19 15:43:39.282743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1040/2187] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:40.305667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:40.306267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:40.313308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:40.313789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:40.314219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:40.314901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:40.315351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:40.315768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:40.377049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:40.385126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ad8f0e36-1cdb-4263-aa12-b6d88d66c709 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083601 Sep 19 15:43:40.385688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1148/2188] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:41.409882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:41.410493 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:41.416813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:41.420279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:41.420279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:41.420279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:41.420279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:41.420746 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:41.486169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:41.495338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5ad48942-774a-4be0-8e7d-f51bfe8ab7c8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089257 Sep 19 15:43:41.495899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1041/2189] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:42.518952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:42.519562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:42.525959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:42.526444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:42.526882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:42.527574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:42.528030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:42.528537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:42.590511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:42.599283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2d7679fe-45a6-4a7b-921a-f77435e0997f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084201 Sep 19 15:43:42.599879 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1149/2190] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:43.624448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:43.625090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:43.631671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:43.632153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:43.632624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:43.633325 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:43.633796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:43.634203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:43.696270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:43.704912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-002ad6b0-ed7b-43d7-b231-424bbd02eaf5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085269 Sep 19 15:43:43.705481 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1042/2191] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:44.727601 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:44.728203 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:44.730559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=42 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:44.736000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:44.736505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:44.736946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:44.737635 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:44.738086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:44.738507 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:44.800130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:44.808310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3faf3fc5-0f2e-4933-a738-cbf3aa4e8875 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084656 Sep 19 15:43:44.808907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1150/2192] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:45.833318 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:45.833930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:45.836225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:45.840987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.841470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.841907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.842610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:45.843055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:45.843501 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:45.908265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:45.916456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-31ea3c5b-c8ba-40dd-bacc-e6212973a118 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087409 Sep 19 15:43:45.917027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1043/2193] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:46.940500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:46.941119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:46.947482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:46.947965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:46.948400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:46.949137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:46.949609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:46.950022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:47.011546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:47.020454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-96a8c38e-3f2c-42b4-82ee-469b95c5c7fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084736 Sep 19 15:43:47.021036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1151/2194] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:48.043438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:48.044002 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:48.051083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.051560 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.051990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.052692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:48.053141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:48.053558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:48.114113 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:48.122296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4c0823ca-9bf3-4315-80b4-654d55f901af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082918 Sep 19 15:43:48.123750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1044/2195] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:49.145848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:49.146491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:49.152960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:49.153434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:49.153921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:49.155287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:49.155727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:49.156141 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:49.219489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:49.225090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-130d6f7f-9b84-4f6d-a8a2-e3f739ea39f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083170 Sep 19 15:43:49.225643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1152/2196] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:50.248424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:50.249102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:50.255656 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:50.256139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:50.256604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:50.257298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:50.257761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:50.258182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:50.262076 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=98 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:50.321417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:50.331081 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-15d775c5-adef-4b99-92e0-1c13b4b097fa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087072 Sep 19 15:43:50.331652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1045/2197] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:50 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:51.354791 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:51.355403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:51.362642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:51.363118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:51.363560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:51.364249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:51.364730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:51.365154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:51.369058 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=94 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:43:51.428799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:51.437012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4abc5b05-d4ae-40f6-867a-e07d23503b08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086187 Sep 19 15:43:51.437571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1153/2198] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:52.460582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:52.461205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:52.467726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:52.468213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:52.468693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:52.469391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:52.469899 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:52.470329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:52.531906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:52.540265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e8798818-3e80-4b05-842a-4af735fa3382 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083734 Sep 19 15:43:52.540894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1046/2199] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:53.563363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:53.564632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:53.571066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:53.571547 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:53.572010 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:53.572734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:53.573215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:53.573637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:53.646182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:53.654369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4a632a03-eb53-4fad-9c16-dfd79841ebc4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.094971 Sep 19 15:43:53.654930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1154/2200] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:54.677461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:54.678074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:54.684434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:54.684948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:54.685384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:54.686077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:54.686535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:54.686964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:54.751676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:54.759882 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e5e276ff-1bd9-44ed-a5da-8b60fe40ab98 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086306 Sep 19 15:43:54.760437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1047/2201] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:55.782842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:55.783489 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:55.789893 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:55.790378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:55.790811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:55.791496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:55.791950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:55.792373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:55.853405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:55.862156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-450b3184-55cd-4dcb-b5a0-5ab7b84c1925 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083277 Sep 19 15:43:55.862726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1155/2202] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:56.884648 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:56.885297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:56.892581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:56.896088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:56.896088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:56.896088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:56.896088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:56.896573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:56.958027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:56.966997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-49515daf-106c-4c06-9837-409ad893d99d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086248 Sep 19 15:43:56.967572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1048/2203] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:57.990432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:57.991065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:57.997880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:57.998364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:57.998800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:57.999488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:57.999963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:58.000381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:58.062506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:58.071210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-362cae07-befa-4bd6-8692-31be2060c1ed tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084703 Sep 19 15:43:58.071765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1156/2204] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:43:59.095364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:43:59.095982 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:43:59.102451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:59.102934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:59.103369 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:59.104059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:43:59.104544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:43:59.105084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:43:59.168833 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:43:59.177748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1d3a669c-4cd7-47de-b3d0-1ad72bfc48de tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086873 Sep 19 15:43:59.178314 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1049/2205] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:43:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:00.201226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:00.201843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:00.208548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.209720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.209720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.210126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:00.210575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:00.210995 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:00.272407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:00.280685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4376c223-7949-4999-bbe5-96f9376b1443 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084048 Sep 19 15:44:00.281259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1157/2206] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:01.303568 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:01.304182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:01.310699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:01.311204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:01.311640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:01.312332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:01.312814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:01.313782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:01.374178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:01.382895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0eccdc32-cf5c-4ddc-a879-6eb8728bb315 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083286 Sep 19 15:44:01.383456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1050/2207] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:01 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:02.406326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:02.407592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:02.414082 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:02.414566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:02.415001 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:02.415681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:02.416134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:02.416577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:02.477430 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:02.485905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aee636fc-f839-4c22-8746-dac6df9cc4a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083375 Sep 19 15:44:02.489986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1158/2208] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:03.509294 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:03.509892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:03.516626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:03.517105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:03.517537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:03.518214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:03.518661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:03.519079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:03.582861 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:03.591079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6fa5f40c-613e-4fb5-a55c-529979b124ec tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085602 Sep 19 15:44:03.591647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1051/2209] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:04.615209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:04.615834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:04.622299 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:04.623039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:04.623498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:04.624190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:04.624671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:04.625094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:04.687990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:04.696960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9eb4eef8-09f9-4382-a887-e306b1d16b7c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085676 Sep 19 15:44:04.697518 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1159/2210] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:05.719825 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:05.720443 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:05.726793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:05.727270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:05.727699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:05.728378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:05.728851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:05.729301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:05.790478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:05.798815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b6f72c53-f1fc-4631-ae96-bc2ba2cb7648 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082901 Sep 19 15:44:05.799410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1052/2211] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:06.824190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:06.824824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:06.832071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:06.832581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:06.833019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:06.833716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:06.834172 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:06.834599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:06.895345 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:06.903446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5dd99ce9-bf92-4826-9e63-4d4bb01864e3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084135 Sep 19 15:44:06.904005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1160/2212] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:07.928107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:07.928747 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:07.934796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:07.935271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:07.935699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:07.936378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:07.936866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:07.937282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:07.999842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:08.007974 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-501614f5-7203-463b-8d70-35dc56aa3784 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083803 Sep 19 15:44:08.008548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1053/2213] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:09.031076 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:09.031633 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:09.038049 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:09.038530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:09.038963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:09.039689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:09.040139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:09.040674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:09.103748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:09.115316 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-41be231c-e457-425a-b03f-c58ae094c4ef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088192 Sep 19 15:44:09.115888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1161/2214] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:10.139291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:10.139901 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:10.146890 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:10.147364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:10.147793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:10.148505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:10.148947 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:10.149366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:10.211689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:10.219900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-660f9e42-f193-405e-baa7-ffde3ec2bc27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084616 Sep 19 15:44:10.220459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1054/2215] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:11.242227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:11.242820 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:11.250732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:11.251214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:11.251644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:11.252367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:11.252852 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:11.253267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:11.313889 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:11.322218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-97fa1b67-7de1-4288-bb20-7004b0f47635 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083808 Sep 19 15:44:11.322772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1162/2216] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:12.345517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:12.346111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:12.352647 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:12.353128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:12.353563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:12.354256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:12.354708 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:12.355135 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:12.420724 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:12.429518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-89744b30-fc99-404b-8f9d-4bcbffb31fba tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088398 Sep 19 15:44:12.430086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1055/2217] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:13.452359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:13.453002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:13.460138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:13.460689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:13.461128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:13.461836 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:13.462293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:13.462719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:13.524529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:13.532760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0d352e4-81bd-408f-9f73-bce2f2ee2c92 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084249 Sep 19 15:44:13.533315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1163/2218] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:14.556235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:14.556907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:14.564522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:14.565007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:14.565445 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:14.566142 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:14.566597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:14.567024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:14.627835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:14.636086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4169cdc8-819a-4ada-8ba1-640b8aa4964f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083764 Sep 19 15:44:14.636677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1056/2219] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:15.660319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:15.660994 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:15.663256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=28 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:15.668106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:15.674065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:15.674065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:15.674065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:15.674065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:15.674501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:15.736414 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:15.750617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b5642a6f-4563-4c8c-8e13-425f32f935f0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.094568 Sep 19 15:44:15.751576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1164/2220] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:16.774127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:16.774668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:16.777072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=28 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:16.781845 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:16.787473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:16.787473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:16.787473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:16.787473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:16.787906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:16.849954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:16.858157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cc172387-772e-4726-820e-54ca9ef475bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088095 Sep 19 15:44:16.858725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1057/2221] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:17.882528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:17.883145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:17.889592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:17.890070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:17.890504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:17.891400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:17.892782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:17.892906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:17.956771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:17.965935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a735f338-85a3-438e-a564-9797d4799e72 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087275 Sep 19 15:44:17.966783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1165/2222] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:18.989515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:18.990090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:19.001181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:19.001181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:19.001181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:19.001181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:19.001625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:19.001625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:19.064452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:19.073015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-57433888-d01f-4790-b45e-f3cc14daad13 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087332 Sep 19 15:44:19.074654 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1058/2223] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:18 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:20.096519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:20.097127 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:20.103472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:20.103945 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:20.104377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:20.105077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:20.105520 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:20.105933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:20.169561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:20.177691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-57a77ff2-94a1-4905-8689-60e54cdebe76 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085196 Sep 19 15:44:20.178243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1166/2224] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:21.201275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:21.201894 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:21.208436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:21.208948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:21.209378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:21.210060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:21.210507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:21.210922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:21.214799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=84 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:21.274796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:21.282847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-15234672-e240-48be-b3ca-e1c3481bc04b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085505 Sep 19 15:44:21.283405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1059/2225] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:22.306092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:22.306719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:22.313952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:22.314429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:22.314863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:22.315540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:22.315989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:22.316406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:22.318947 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=84 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:22.378824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:22.386886 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-42205333-2a45-4351-9217-0644c95e900e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084828 Sep 19 15:44:22.387439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1167/2226] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:23.410180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:23.410805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:23.417799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:23.418283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:23.418717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:23.419408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:23.419885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:23.420316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:23.480744 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:23.489676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dc71c845-a205-4eb0-9f53-d728e2baf216 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083346 Sep 19 15:44:23.490248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1060/2227] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:24.513747 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:24.514368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:24.522155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:24.522638 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:24.523075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:24.523785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:24.524238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:24.524695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:24.589913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:24.598546 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-25d8a08f-ade0-4eae-b450-20965b552448 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088832 Sep 19 15:44:24.599052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1168/2228] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:25.621456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:25.622110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:25.629657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:25.630164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:25.630580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:25.631274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:25.631733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:25.632161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:25.701012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:25.709609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ac81e5ce-bc8d-4c8b-8b92-2533028efe93 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.092004 Sep 19 15:44:25.710384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1061/2229] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:26.732572 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:26.733140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:26.739692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:26.740174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:26.740648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:26.741340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:26.741790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:26.742214 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:26.811855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:26.814112 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6e00d172-b25f-4ba1-9bca-2bccc8ac90f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085560 Sep 19 15:44:26.814663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1169/2230] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:27.837624 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:27.838277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:27.845750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:27.846234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:27.846675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:27.847375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:27.847828 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:27.848257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:27.913015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:27.921174 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fd9a5ba9-0aa9-4349-aa80-ef6002aa23ea tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087462 Sep 19 15:44:27.921742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1062/2231] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:44:28.944725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:28.945336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:28.951673 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:28.952152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:28.952610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:28.953399 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:28.953952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:28.954375 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:29.015013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:29.023275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f0e6b1bb-dffa-4587-91cb-17a9563e0486 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082599 Sep 19 15:44:29.023831 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1170/2232] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:28 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:30.046050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:30.046593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:30.053483 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:30.053968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:30.054401 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:30.055119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:30.055573 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:30.055997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:30.119290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:30.128293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a103318f-500b-4b44-a3a8-723d63cdf7c5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086274 Sep 19 15:44:30.128910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1063/2233] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:31.150291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:31.150908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:31.157459 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:31.157942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:31.158377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:31.159066 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:31.159522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:31.159956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:31.221497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:31.229818 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e9a63368-ddcd-49e0-9186-3dcb6d0b70a9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083377 Sep 19 15:44:31.230378 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1171/2234] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:32.257080 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:32.257694 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:32.264105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:32.264616 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:32.265053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:32.266269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:32.266721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:32.267149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:32.328512 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:32.337004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea02f971-da30-46a3-b0c0-6acd0c1041c1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083681 Sep 19 15:44:32.337581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1064/2235] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:33.361398 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:33.362005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:33.368502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:33.368975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:33.369407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:33.370083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:33.370528 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:33.370944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:33.433822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:33.442028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d036376d-b77e-4b6f-88f9-ee09c5fc682e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085207 Sep 19 15:44:33.442580 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1172/2236] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:34.465354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:34.465953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:34.472439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.472945 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.473377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.474058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:34.474505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:34.474922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:34.537990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:34.546067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-12213fa8-2f7f-4629-bc8f-9bc7b40e0f6b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084925 Sep 19 15:44:34.547172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1065/2237] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:35.569500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:35.570116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:35.577038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.577526 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.579265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.580309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:35.581024 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:35.581455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:35.643850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:35.651993 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8ab4cbc9-a298-4ba2-8758-69fa53a4bd0e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086380 Sep 19 15:44:35.652573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1173/2238] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:36.676673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:36.677293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:36.683347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:36.683834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:36.684273 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:36.684995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:36.685456 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:36.685933 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:36.746043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:36.754872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e037c50d-7812-41f9-ba42-1c155f7fd8a8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082993 Sep 19 15:44:36.755449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1066/2239] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:37.778608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:37.779009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:37.785631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:37.786115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:37.786551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:37.787248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:37.787699 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:37.788126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:37.849170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:37.857360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fb3c8151-292c-44ad-8108-38c853f85ce4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083095 Sep 19 15:44:37.857923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1174/2240] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:38.881179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:38.881798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:38.888252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:38.888771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:38.889211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:38.889908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:38.891101 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:38.891535 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:38.955569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:38.963742 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0bd5c97d-9ca5-410d-9096-de0b9f4ab0cb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086509 Sep 19 15:44:38.964305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1067/2241] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:39.985902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:39.986537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:39.993057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:39.993539 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:39.993978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:39.994669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:39.995124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:39.995549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:40.056616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:40.065761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-10aa4cf4-e0a6-4010-94fd-e9491c9ce904 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083833 Sep 19 15:44:40.066321 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1175/2242] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:39 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:41.089172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:41.089844 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:41.097053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:41.097597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:41.098043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:41.098754 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:41.099243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:41.099675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:41.163719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:41.172870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9064e897-44c1-489e-87e4-5b1ca81f165a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087379 Sep 19 15:44:41.173446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1068/2243] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:42.195760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:42.196354 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:42.202948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:42.203425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:42.203862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:42.204576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:42.205036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:42.205461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:42.267236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:42.275380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-14aeffa2-9be3-4588-9419-f245dd96ca2b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083500 Sep 19 15:44:42.276885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1176/2244] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:43.299093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:43.299716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:43.306139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:43.306625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:43.307062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:43.307756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:43.308215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:43.308699 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:43.375461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:43.384137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b153b758-bd4d-439d-92a8-b0b45df3451c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.089238 Sep 19 15:44:43.384738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1069/2245] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:43 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:44.408801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:44.409410 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:44.415895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:44.416373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:44.416833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:44.417524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:44.417969 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:44.418387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:44.479061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:44.487484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1448484e-f8cf-4a56-8e31-2d2229aeeed0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083250 Sep 19 15:44:44.488041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1177/2246] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:44 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:45.510658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:45.511303 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:45.518074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:45.518559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:45.518995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:45.519693 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:45.520149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:45.520601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:45.581609 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:45.590234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-52a69bea-646d-47ff-9ef3-b975b08475e8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083392 Sep 19 15:44:45.590832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1070/2247] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:45 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:46.618243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:46.618992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:46.621496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=28 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:46.629448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:46.632465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:46.632465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:46.632465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:46.632465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:46.632923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:46.693612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:46.701752 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-57a7f013-d07c-42fc-8420-857c140ee6f6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.090647 Sep 19 15:44:46.702313 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1178/2248] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:46 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:47.725377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:47.725932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:47.728182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=28 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:47.732919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:47.733430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:47.733870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:47.734601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:47.735062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:47.735484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:47.801537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:47.809715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-94a9972e-dfe2-4245-af26-037a128b4886 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088376 Sep 19 15:44:47.810275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1071/2249] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:47 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:48.834557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:48.835174 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:48.841687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:48.842165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:48.842602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:48.843290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:48.843849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:48.844290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:48.907825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:48.916104 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a8ea2fe-541b-485d-8ff3-7ca737eff8af tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085557 Sep 19 15:44:48.916695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1179/2250] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:48 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:49.940178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:49.940835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:49.947319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:49.947805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:49.948248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:49.948987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:49.949449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:49.949876 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:50.012203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:50.021023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1186ef2a-4919-4399-a4f9-24c81da679bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085621 Sep 19 15:44:50.021591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1072/2251] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:49 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:51.043208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:51.043796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:51.050317 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:51.050795 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:51.051223 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:51.051899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:51.052344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:51.052786 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:51.114045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:51.122115 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-74ab86e2-664c-43b1-a497-4dba7124ad27 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082858 Sep 19 15:44:51.122934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1180/2252] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:51 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:52.145403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:52.146053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:52.152618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:52.153104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:52.153549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:52.154240 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:52.154701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:52.155131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:52.219596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:52.227949 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-477cff70-bd66-4531-97fc-efd016bf15d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086830 Sep 19 15:44:52.228544 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1073/2253] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:52 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:53.252026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:53.252674 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:53.259052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:53.259524 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:53.259959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:53.260687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:53.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:53.261537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:53.264014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=84 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:53.330857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:53.339043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1b4b02ff-74a8-4af9-ac2e-aea3df7557bd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.091900 Sep 19 15:44:53.339606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1181/2254] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:53 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:54.362433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:54.368649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:54.369421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:54.369902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:54.370332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:54.371013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:54.371463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:54.371879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:54.374650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=90 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:44:54.434476 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:54.443410 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-53060325-59a2-4c3b-949a-cfd135907184 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084987 Sep 19 15:44:54.443988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1074/2255] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:54 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:55.470975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:55.471586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:55.478130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:55.478602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:55.479032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:55.479711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:55.480156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:55.480604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:55.543013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:55.553081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-181d894b-47fd-40a8-b163-63bd6a76fe26 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086051 Sep 19 15:44:55.553690 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1182/2256] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:55 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:56.577232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:56.579511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:56.585437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:56.585922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:56.586366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:56.587107 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:56.587565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:56.588373 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:56.653479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:56.661707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9f5050cf-68b3-497d-9b38-26757aea198b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088706 Sep 19 15:44:56.662296 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1075/2257] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:56 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:57.684407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:57.684991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:57.691339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:57.691832 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:57.692242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:57.692959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:57.693401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:57.693816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:57.754421 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:57.762953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dd18983a-8ecf-4e1f-8bdd-ffc489888446 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082469 Sep 19 15:44:57.763523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1183/2258] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:57 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:58.787439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:58.788093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:58.794586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:58.795065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:58.795504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:58.796203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:58.797279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:58.797725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:58.858301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:58.867102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-742ee2ea-fa40-4d4e-910f-84f91bed76f3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083538 Sep 19 15:44:58.867668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1076/2259] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:58 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:44:59.890482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:44:59.891639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:44:59.898084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:59.898569 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:59.899005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:59.899686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:44:59.900137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:44:59.900593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:44:59.961028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:44:59.969226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fc410c52-9ffa-4d38-822c-c5dc0dfec8c7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082772 Sep 19 15:44:59.969788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1184/2260] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:44:59 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:00.993179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:00.993776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:01.000384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:01.000885 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:01.001973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:01.002827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:01.003279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:01.003700 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:01.066999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:01.075030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-28bfe420-7a48-4f72-b751-fc2abe0ec59a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085741 Sep 19 15:45:01.075586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1077/2261] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:02.097568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:02.098187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:02.104626 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:02.105109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:02.105552 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:02.106236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:02.106686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:02.107111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:02.408628 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:02.416984 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-432fbfa6-b237-4215-a3ca-32984796139f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.323407 Sep 19 15:45:02.417559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1185/2262] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:02 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:03.439515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:03.440106 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:03.446489 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:03.446966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:03.447395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:03.448077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:03.448546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:03.448967 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:03.509611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:03.517957 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c38632cc-eb85-42c5-a124-0137359beb51 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082515 Sep 19 15:45:03.518510 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1078/2263] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:03 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:04.541171 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:04.541785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:04.548114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:04.548624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:04.549059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:04.549742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:04.550190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:04.550603 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:04.614987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:04.623405 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-926944fc-28c6-43cc-bef5-cde63079d473 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085814 Sep 19 15:45:04.623970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1186/2264] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:04 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:05.647121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:05.647681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:05.654132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:05.654617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:05.655057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:05.655752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:05.656208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:05.656670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:05.722953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:05.731160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7dcee42c-b510-486c-bd46-c9300db60da3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088229 Sep 19 15:45:05.731723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1079/2265] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:05 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:06.754501 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:06.755037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:06.761265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:06.761748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:06.762181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:06.762864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:06.763331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:06.763734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:06.826864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:06.835810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-60fafdf3-0a65-4393-bca0-972524434b9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085724 Sep 19 15:45:06.836379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1187/2266] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:06 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:07.859389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:07.859997 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:07.866778 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:07.867251 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:07.867684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:07.868367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:07.868850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:07.869265 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:08.084024 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:08.092245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-985a8b96-54b0-4339-88fe-fb2af21b501b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.236961 Sep 19 15:45:08.092847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1080/2267] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:07 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:09.114386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:09.115040 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:09.122467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:09.122940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:09.123632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:09.124407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:09.124936 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:09.125447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:09.187739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:09.196807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3b091786-1e56-40c5-a59c-8575ba6ed831 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086357 Sep 19 15:45:09.197460 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1188/2268] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:09 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:10.222715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:10.223397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:10.229784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:10.230270 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:10.230709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:10.231404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:10.231859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:10.232338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:10.294938 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:10.303706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-802c9256-9e75-4129-b0a9-ae135dec8a88 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085515 Sep 19 15:45:10.305087 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1081/2269] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:10 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:11.326811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:11.327425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:11.333891 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:11.334428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:11.334892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:11.335482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:11.335935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:11.336360 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:11.405908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:11.413042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ca3ffe5a-e334-4898-9435-13e334fdd464 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.090245 Sep 19 15:45:11.413622 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1189/2270] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:11 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:12.435941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:12.436583 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:12.443863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:12.444349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:12.444822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:12.445515 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:12.446007 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:12.446435 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:12.510810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:12.519794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0bbac53e-6dec-46ae-a013-7f2a56f96f08 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087688 Sep 19 15:45:12.520362 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1082/2271] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:12 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:13.543131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:13.543743 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:13.551328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:13.551828 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:13.552239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:13.552949 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:13.553400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:13.553821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:13.615060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:13.623295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-99005bbd-cec0-4550-a599-e65db38ecaac tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084057 Sep 19 15:45:13.624131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1190/2272] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:13 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:14.647821 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:14.648442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:14.654823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:14.655298 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:14.655725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:14.656407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:14.656887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:14.657306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:14.720012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:14.728453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4785e456-398a-461c-9271-ab8036fbd0ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084538 Sep 19 15:45:14.729225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1083/2273] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:14 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:45:15.751264 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:15.751920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:15.758854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:15.759336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:15.759770 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:15.760454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:15.760997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:15.761415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:15.825602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:15.834556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9fe6c17e-b9e0-4e3d-b138-6b217d5f51f9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087617 Sep 19 15:45:15.835182 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1191/2274] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:15 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:16.859657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:16.860264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:16.867851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:16.868339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:16.868819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:16.869521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:16.869979 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:16.870407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:16.937040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:16.949448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bbff5744-3630-4282-a16c-9ef86debd56d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.094914 Sep 19 15:45:16.950028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1084/2275] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:16 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:17.973145 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:17.973732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:17.976137 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=28 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:17.980788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:17.981265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:17.981692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:17.982371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:17.982814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:17.983225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:18.044611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:18.053261 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-866a10b4-1c43-4b90-a34a-05547a04dc23 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084042 Sep 19 15:45:18.053811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1192/2276] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:17 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:19.076550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:19.077172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:19.079598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=28 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:19.085475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:19.090526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:19.090526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:19.090526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:19.090526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:19.090952 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:19.150226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:19.158691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e769e19b-63e9-4a68-bb5a-3baeeb97bae1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085811 Sep 19 15:45:19.159259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1085/2277] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:19 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:20.181738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:20.182356 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:20.188806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:20.189342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:20.189776 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:20.190461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:20.190922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:20.191343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:20.258005 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:20.266207 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f799e185-d27b-4a4e-b543-16dc7b03c008 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088426 Sep 19 15:45:20.266772 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1193/2278] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:20 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:21.291989 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:21.292621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:21.299601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:21.300078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:21.314037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:21.314037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:21.314037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:21.314037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:21.364365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:21.372635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-768169e2-6d03-4a5b-8979-e85c7a750ddc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084490 Sep 19 15:45:21.373667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1086/2279] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:21 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:22.396435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:22.397069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:22.403434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:22.403907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:22.404370 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:22.405073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:22.405515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:22.405931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:22.467268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:22.475796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-62300005-0453-4135-b9c6-a06a19536f41 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083830 Sep 19 15:45:22.476355 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1194/2280] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:22 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:23.499895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:23.500522 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:23.507022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:23.507495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:23.507923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:23.508635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:23.509082 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:23.509528 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:23.569770 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:23.577791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5256b908-42aa-4552-ab81-bb04f44dbc2e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.081987 Sep 19 15:45:23.578349 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1087/2281] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:23 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:24.602061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:24.602679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:24.609224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:24.609700 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:24.610135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:24.610899 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:24.612108 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:24.612537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:24.615072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=84 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:24.676759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:24.684873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-54de15b6-c779-4c03-b379-cf58e19ff9db tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.086745 Sep 19 15:45:24.685434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1195/2282] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:24 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:25.708403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:25.708976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:25.715275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:25.715752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:25.716182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:25.716896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:25.717343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:25.717767 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:25.788388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:25.796673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5c695d45-1aa7-4d68-b391-3f626c2ca69a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.092566 Sep 19 15:45:25.797235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1088/2283] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:25 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:26.820336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:26.820968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:26.827300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:26.832602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:26.832602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:26.832602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:26.832602 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:26.832998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:26.891071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:26.899953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e196ef18-0e17-42ec-a4e9-0328cb459574 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083515 Sep 19 15:45:26.900532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1196/2284] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:26 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:27.922787 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:27.923391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:27.931460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:27.931937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:27.932364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:27.933088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:27.933534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:27.933951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:27.936496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=90 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:27.997748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:28.007005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c269f026-6de2-4031-ac23-9e38cab844ca tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.088090 Sep 19 15:45:28.007572 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1089/2285] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:27 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:29.030291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:29.030834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:29.037839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:29.038315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:29.038745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:29.039431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:29.039876 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:29.040296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:29.102496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:29.110530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4c026687-b694-4d9b-b489-dfd4af71ea31 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.084352 Sep 19 15:45:29.111091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1197/2286] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:29 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:30.134326 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:30.134987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:30.141611 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:30.142096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:30.142563 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:30.143526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:30.143987 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:30.144420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:30.206888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:30.218062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-773b8b7a-ae5e-46f3-9fc2-dc557a6fddc6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087617 Sep 19 15:45:30.221851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1090/2287] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:30 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:31.241485 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:31.242128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:31.248561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:31.249130 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:31.249550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:31.250492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:31.250948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:31.251365 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:31.312069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:31.320850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8c8f7dd5-ade7-4acf-874a-f0e187744ce5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083435 Sep 19 15:45:31.321423 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1198/2288] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:31 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:32.344665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:32.345271 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:32.352321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:32.352843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:32.353285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:32.353980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:32.354437 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:32.354866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:32.415814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:32.424072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b0ec9814-c728-46e0-996e-a2917fd89735 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083374 Sep 19 15:45:32.424668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1091/2289] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:32 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:33.446646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:33.447291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:33.453737 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:33.454219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:33.454658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:33.455384 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:33.455841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:33.456262 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:33.522011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:33.530165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ef0bb5b0-1ddf-43c4-b29b-08412f18585f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087422 Sep 19 15:45:33.530733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1199/2290] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:33 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:34.554289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:34.554889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:34.561345 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:34.561832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:34.562275 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:34.562963 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:34.563420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:34.563848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:34.624237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:34.633555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e29d5710-f4cd-4ccb-93d1-d836b8588aef tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.083120 Sep 19 15:45:34.634155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1092/2291] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:34 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:35.656981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:35.657532 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:35.664043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.664551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.664987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.665670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:35.666119 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:35.666540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:35.727205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:35.735232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3862dcbf-3e56-45a3-bc9d-9ba20a615053 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.082336 Sep 19 15:45:35.735788 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1200/2292] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:35 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:36.758980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:36.759596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:36.765601 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:36.766086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:36.766527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:36.767217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:36.767680 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:36.768110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:36.832237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:36.840427 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b5ffeb2d-65c7-41c1-b5e0-73f73b6122e5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085500 Sep 19 15:45:36.841026 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1093/2293] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:36 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:37.865630 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:37.866255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:37.872637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:37.873117 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:37.873548 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:37.874235 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:37.874755 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:37.875475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:37.940138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:37.949164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-686d0a66-8aef-4e0a-812d-d46277267026 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087744 Sep 19 15:45:37.949934 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1201/2294] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:37 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:38.973205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:38.973774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:38.980518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:38.981009 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:38.981447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:38.982164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:38.982665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:38.983092 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:39.045441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:39.053759 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fc8d098f-4218-45f9-b2f8-f8dd7e8b7992 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.085257 Sep 19 15:45:39.054323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1094/2295] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:38 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:40.077045 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:40.077654 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:40.084387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:40.084904 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:40.085338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:40.086020 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:40.086464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:40.086922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:40.152113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:40.160597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5829c89e-b723-4a4b-b455-12463fe39ffd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1372 microversion: 2.1 time: 0.087646 Sep 19 15:45:40.161154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1202/2296] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:40 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:41.192625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:41.192625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:41.197151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:41.197847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:41.198460 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:41.199537 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:41.200164 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:41.200811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:41.236452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:41.236973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:41.237986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:41.237986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'fault' on Instance uuid 2751262b-7323-4c6a-b3f1-830fb2448558 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:45:41.280907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:41.291718 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-135880b7-cdaa-40a3-a59a-89815c4935e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 200 len: 1466 microversion: 2.1 time: 0.109579 Sep 19 15:45:41.292353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1095/2297] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:41 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 1466 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:42.489585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:42.490901 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:42.497846 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:42.498551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:42.499300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:42.500190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:42.501095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:42.501692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:42.521854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 HTTP/1.1 Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:45:42.524702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:45:42.526466 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '2751262b-7323-4c6a-b3f1-830fb2448558'} Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:42.527508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:45:42.529254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:42.531541 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:42.532619 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2987ed3f-8a61-457b-87da-ce43340b30d5 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 404 len: 111 microversion: 2.1 time: 0.221321 Sep 19 15:45:42.533350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1203/2298] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:42 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:45:42.542279 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-cbbd16be-2d7b-46f2-9c43-a180023eea9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '.version_select at 0x7f41fb453820>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:42.546428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cbbd16be-2d7b-46f2-9c43-a180023eea9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [9adc1552-bab9-44a5-a369-2c8fb7a24a88] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:45:42.820446 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-0e330be7-163e-4e3e-9422-9e07f3c5cd4a req-6bf4f39a-1d20-43da-a453-fb30c919ded2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed221b61-f2e4-4a1c-88db-8ee956c45e7a", "name": "network-vif-deleted", "tag": "3d83abc7-f529-4348-8819-5564b12f7aa1"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:42.829921 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-0e330be7-163e-4e3e-9422-9e07f3c5cd4a req-6bf4f39a-1d20-43da-a453-fb30c919ded2 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:42.830542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-0e330be7-163e-4e3e-9422-9e07f3c5cd4a req-6bf4f39a-1d20-43da-a453-fb30c919ded2 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:42.830809 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-0e330be7-163e-4e3e-9422-9e07f3c5cd4a req-6bf4f39a-1d20-43da-a453-fb30c919ded2 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:42.842267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-0e330be7-163e-4e3e-9422-9e07f3c5cd4a req-6bf4f39a-1d20-43da-a453-fb30c919ded2 service nova] Creating event network-vif-deleted:3d83abc7-f529-4348-8819-5564b12f7aa1 for instance ed221b61-f2e4-4a1c-88db-8ee956c45e7a on hv-cinder-75671 Sep 19 15:45:42.847593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-0e330be7-163e-4e3e-9422-9e07f3c5cd4a req-6bf4f39a-1d20-43da-a453-fb30c919ded2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158162 Sep 19 15:45:42.848256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1204/2299] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:45:43.555453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [None req-cbbd16be-2d7b-46f2-9c43-a180023eea9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [9adc1552-bab9-44a5-a369-2c8fb7a24a88] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54916. Sep 19 15:45:43.628067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-cbbd16be-2d7b-46f2-9c43-a180023eea9a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356085505" status: 202 len: 0 microversion: 2.1 time: 1.090070 Sep 19 15:45:43.628733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1096/2300] 10.222.0.75 () {58 vars in 1218 bytes} [Mon Sep 19 15:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356085505 => generated 0 bytes in 1091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:45:44.620611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2f50590d-42f5-4a00-b044-f49c838c5d8f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: .version_select at 0x7f41fed8ee50>, body: {"keypair": {"name": "tempest-keypair-1621921576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImzfVCBqy0+usma1Wfe9YRDVJXyq6G4P6xq93vqzF8NJJWW+PxIruDpW0M4dvuILoQ8bpdE3WYPocZLZZY6xqSQniKX/2EeJkvomzjlDRiZYLFh7Mo5f0+XLEbmDHT3lw=="}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:44.637193 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-2f50590d-42f5-4a00-b044-f49c838c5d8f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:45:44.649338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-2f50590d-42f5-4a00-b044-f49c838c5d8f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:45:44.653473 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f50590d-42f5-4a00-b044-f49c838c5d8f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [a2b469f1-1f05-4f8e-8021-d22aaa378b1f] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:45:45.661062 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f50590d-42f5-4a00-b044-f49c838c5d8f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [a2b469f1-1f05-4f8e-8021-d22aaa378b1f] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54972. Sep 19 15:45:45.722903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2f50590d-42f5-4a00-b044-f49c838c5d8f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.104942 Sep 19 15:45:45.722903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1205/2301] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:45:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:45:47.944978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2016747650", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117"}], "security_groups": [{"name": "tempest-securitygroup--1335207483"}], "key_name": "tempest-keypair-1621921576", "user_data": "}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:48.068191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] validate_networks() for [('bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:45:48.575525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:45:48.575995 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:45:48.576695 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:45:48.577183 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:45:48.577584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:45:48.588533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:48.593115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:48.593115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:48.593115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:48.593115 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:48.593660 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:48.609239 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:45:48.613131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:45:48.624090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:45:48.627508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:45:48.736250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [36cee8b2-709e-461b-8d96-104d6d124bab] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:45:49.281769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:49.283037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:49.286080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:49.291240 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.291617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.292055 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.292827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.293462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.293896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.309215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 HTTP/1.1 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:45:49.311054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.312976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'a99bd356-ddca-4b48-99db-8ea35f0bc190'} Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:49.314016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.315739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.318453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:49.319941 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c856a6bd-4ea8-43b4-90e7-8dcb190f90a7 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 404 len: 111 microversion: 2.20 time: 0.041541 Sep 19 15:45:49.320669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1206/2302] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:45:49 2022] DELETE /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:45:49.333819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:49.334454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: a99bd356-ddca-4b48-99db-8ea35f0bc190] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:49.340589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.341070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.341502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.342186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:49.342634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:49.343056 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:49.356442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 HTTP/1.1 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:45:49.357990 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.359726 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'a99bd356-ddca-4b48-99db-8ea35f0bc190'} Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:49.360744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. Sep 19 15:45:49.362402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:49.364278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance a99bd356-ddca-4b48-99db-8ea35f0bc190 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:49.364278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-36a58d10-c06e-4da7-8a91-5ecb4c06d5fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190" status: 404 len: 111 microversion: 2.20 time: 0.029512 Sep 19 15:45:49.364278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1207/2303] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:45:49 2022] GET /compute/v2.1/servers/a99bd356-ddca-4b48-99db-8ea35f0bc190 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:45:49.744621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [36cee8b2-709e-461b-8d96-104d6d124bab] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 55082. Sep 19 15:45:49.748538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9e350912-10b1-4a0c-a84b-923caa1983cd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.808526 Sep 19 15:45:49.749222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1097/2304] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:45:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:45:49.761484 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8986f627-1c56-41d8-8d88-d6b28ce2d5aa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:49.762093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8986f627-1c56-41d8-8d88-d6b28ce2d5aa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:50.029814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8986f627-1c56-41d8-8d88-d6b28ce2d5aa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:50.037109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8986f627-1c56-41d8-8d88-d6b28ce2d5aa tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1242 microversion: 2.1 time: 0.280330 Sep 19 15:45:50.037672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1208/2305] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:49 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1242 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:45:50.549789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:50.550630 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:50.553290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:50.560511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.565063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.565063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.565063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.565063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.565672 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.593635 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f HTTP/1.1 Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:45:50.595342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.599807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'b3b26b35-8784-4bb4-8d1b-b962f6104f7f'} Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:50.600836 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.602820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.604459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:50.604459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e27329f1-854b-4d83-94f8-b001f3bfdf69 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 404 len: 111 microversion: 2.1 time: 0.053160 Sep 19 15:45:50.604459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1098/2306] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:45:50 2022] DELETE /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:45:50.608723 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:50.609344 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: b3b26b35-8784-4bb4-8d1b-b962f6104f7f] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:50.616666 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.617210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.617660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.618376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.618833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.619260 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.633944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f HTTP/1.1 Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:45:50.635604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.637480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'b3b26b35-8784-4bb4-8d1b-b962f6104f7f'} Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:50.641607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. Sep 19 15:45:50.643057 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.644660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance b3b26b35-8784-4bb4-8d1b-b962f6104f7f could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:50.644660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-189cf26f-7cd3-47b3-8e97-496929a48a74 tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f" status: 404 len: 111 microversion: 2.1 time: 0.033897 Sep 19 15:45:50.644660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1209/2307] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:50 2022] GET /compute/v2.1/servers/b3b26b35-8784-4bb4-8d1b-b962f6104f7f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:45:50.644956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:50.644956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:50.649653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.650140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.650581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.651282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.651924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.652390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.666722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:45:50.668299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.670305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:50.671211 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.672925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.681347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:50.681347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c5df8857-8d46-4809-b4cb-4c2473d1f4fe tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.033737 Sep 19 15:45:50.681347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1099/2308] 10.222.0.75 () {60 vars in 1280 bytes} [Mon Sep 19 15:45:50 2022] DELETE /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:45:50.682043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:50.682304 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] [instance: 94201d17-c5c8-44d8-b1ea-5cec58d30ede] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:50.688267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.688787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.689301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.690000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:50.690522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:50.690952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:50.706748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] HTTP exception thrown: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Request method failure captured: Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede HTTP/1.1 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY-HUAQx-0HXYJXydQGw26RGJy8DLp8BPDh0lCdw4QfR6HDmiuGllPNSxjmcQrpvAkLkpTD1U5xXFSnaebNxToBrgqYlj6yG7cybyYetKbCVpeNUkyOVKu_h3SJ5tmxMe_U41QGuEhy7MjGtR9uOh7_XxOLWwyj909a4BpZ8SSmjB0 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:45:50.711703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4de2627ff884f9f9afd68edb0dadf26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4de2627ff884f9f9afd68edb0dadf26"}]}] Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: e4de2627ff884f9f9afd68edb0dadf26 Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1292002700 Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 808156c7457b4e8b9b6c5f305755b3f3 Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1292002700-project Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.713581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '94201d17-c5c8-44d8-b1ea-5cec58d30ede'} Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:50.714568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. Sep 19 15:45:50.716244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:50.718202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] Returning 404 to user: Instance 94201d17-c5c8-44d8-b1ea-5cec58d30ede could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:50.718202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c7bee386-e728-42b8-ac76-3765b44ada66 tempest-AttachVolumeShelveTestJSON-1292002700 tempest-AttachVolumeShelveTestJSON-1292002700-project] 10.222.0.75 "GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede" status: 404 len: 111 microversion: 2.20 time: 0.035180 Sep 19 15:45:50.718202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1210/2309] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Sep 19 15:45:50 2022] GET /compute/v2.1/servers/94201d17-c5c8-44d8-b1ea-5cec58d30ede => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:45:51.060709 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:51.061903 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:51.069461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:51.075800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:51.075800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:51.075800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:51.075800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:51.076944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:51.137333 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:51.145012 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3148f78-ccce-4734-a850-72abaf0c467e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1246 microversion: 2.1 time: 0.088221 Sep 19 15:45:51.145570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1100/2310] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:51 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:52.022209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:52.023078 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:52.029691 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:45:52.029942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:45:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 (ip 10.222.0.75) !!! Sep 19 15:45:52.056439 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.058777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.059220 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.059956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.060419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.060860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.078151 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:45:52.079591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.081221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:52.082400 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.084269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.086121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:52.086121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cf14cbdc-d0b2-414c-9a5f-b836254893bc tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.077200 Sep 19 15:45:52.086121 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1211/2311] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:45:52 2022] DELETE /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:45:52.093058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:52.093685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] [instance: 0a37d13a-b506-47f9-9473-9263fa583258] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:52.102819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.103554 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.104004 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.104755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.105217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.105649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.121097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] HTTP exception thrown: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Request method failure captured: Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 HTTP/1.1 Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY5xWxiQaAzkZIbVr48xULuCPSBbeWQdIDbXjBHYIjp3m4Oq1v4f2tH2rzNnN8Krq90LfD0HfWMochA6rJ5-OIX149B07KWLGIi6pm8rUTT35s7eQoAs720Xhyv_zmeO6J6rtEG0L9DgaM1KW5XEtFDr2gdOzCaodd6vYMBpuUC5nw Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:45:52.122652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c727384d4ff043809f8421840cbd7596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c727384d4ff043809f8421840cbd7596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c727384d4ff043809f8421840cbd7596"}]}] Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: c727384d4ff043809f8421840cbd7596 Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-837700054 Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 833edf46ef9b4d3982ce49abc74933a2 Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeTestJSON-837700054-project Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.124496 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '0a37d13a-b506-47f9-9473-9263fa583258'} Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:45:52.125728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. Sep 19 15:45:52.128458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:45:52.130539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] Returning 404 to user: Instance 0a37d13a-b506-47f9-9473-9263fa583258 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:45:52.130539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f2e9b600-78e8-495e-8bea-b9056269299d tempest-AttachVolumeTestJSON-837700054 tempest-AttachVolumeTestJSON-837700054-project] 10.222.0.75 "GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258" status: 404 len: 111 microversion: 2.1 time: 0.036767 Sep 19 15:45:52.130539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1101/2312] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:52 2022] GET /compute/v2.1/servers/0a37d13a-b506-47f9-9473-9263fa583258 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:45:52.171759 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:52.172605 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:52.180389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.181095 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.181625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.182431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:52.183230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:52.184745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:52.303269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:52.325857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c23215cc-7474-4d57-93db-f5317a854478 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1294 microversion: 2.1 time: 0.159472 Sep 19 15:45:52.344573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1212/2313] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:52 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:53.352826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:53.353595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:53.360376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.362390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.362390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.363330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:53.364385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:53.364953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:53.806649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:53.822368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-fac3b0e0-70a3-4e2b-a4b5-d0c210e7edfd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1300 microversion: 2.1 time: 0.473421 Sep 19 15:45:53.823953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1102/2314] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:53 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1300 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:54.847461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:54.848882 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:54.855903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:54.856566 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:54.857094 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:54.858042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:54.858707 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:54.859191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:54.862257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=68 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:55.314134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:55.328002 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a12df5a8-5911-4dc4-ae91-25f3c4fd0f99 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.484149 Sep 19 15:45:55.330187 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1213/2315] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:54 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:55.930181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-88259a39-e5cd-4464-8f6a-8a7151100c7d req-2fc25a9b-ea50-4734-b581-6f1f934d1006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6166990c-0852-41cb-bb42-9ea385160606", "tag": "5d26d73b-042a-4dbf-8733-5d3b699dc0ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:45:55.942731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-88259a39-e5cd-4464-8f6a-8a7151100c7d req-2fc25a9b-ea50-4734-b581-6f1f934d1006 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:55.943438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-88259a39-e5cd-4464-8f6a-8a7151100c7d req-2fc25a9b-ea50-4734-b581-6f1f934d1006 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:55.944994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-88259a39-e5cd-4464-8f6a-8a7151100c7d req-2fc25a9b-ea50-4734-b581-6f1f934d1006 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:55.958358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-88259a39-e5cd-4464-8f6a-8a7151100c7d req-2fc25a9b-ea50-4734-b581-6f1f934d1006 service nova] Creating event network-changed:5d26d73b-042a-4dbf-8733-5d3b699dc0ed for instance 6166990c-0852-41cb-bb42-9ea385160606 on hv-cinder-75671 Sep 19 15:45:55.965124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-88259a39-e5cd-4464-8f6a-8a7151100c7d req-2fc25a9b-ea50-4734-b581-6f1f934d1006 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038955 Sep 19 15:45:55.966539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1103/2316] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:45:56.352817 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:56.353543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:56.359732 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.360237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.360717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.361525 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:56.361992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:56.362422 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:56.570406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:56.582467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e75f5340-89e0-45b1-a343-062b9063c3f2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.233405 Sep 19 15:45:56.583374 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1214/2317] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:56 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:57.609124 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:57.609768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:57.617366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:57.617972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:57.618465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:57.619154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:57.619613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:57.620040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:57.837475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:57.847421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3b334822-5dce-4dd8-9d8e-52fe6dd94c3b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.240300 Sep 19 15:45:57.847421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1104/2318] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:57 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:58.870000 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:45:58.870753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:45:58.877161 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:58.877640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:58.878075 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:58.878771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:45:58.879222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:45:58.879646 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:45:59.015388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:45:59.023906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0dcda7ca-8eaa-40a1-b614-85e470fa786e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.158019 Sep 19 15:45:59.024562 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1215/2319] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:45:58 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:45:59.692706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:59.693918 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:45:59.806000 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f3e0fb12-51ca-484c-829c-194718e3c962 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Action: 'create', calling method: .version_select at 0x7f41fed8af70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1671467380", "metadata": {"Type": "work"}}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:00.046708 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:00.047351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:00.049671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=6 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:00.054563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.055052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.055495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.056189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:00.056684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:00.057111 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:00.190257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:00.204471 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a2f6a449-65d7-4c84-8344-78d9215b872d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.161152 Sep 19 15:46:00.205557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1216/2320] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:00 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:46:00.472448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f3e0fb12-51ca-484c-829c-194718e3c962 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.784220 Sep 19 15:46:00.473128 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1105/2321] 10.222.0.75 () {60 vars in 1156 bytes} [Mon Sep 19 15:45:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 786 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 15:46:00.486590 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-dc6c5e66-6993-4a9e-a5c9-80fd8671c0f1 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41febe30d0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:00.535982 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-dc6c5e66-6993-4a9e-a5c9-80fd8671c0f1 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 353 microversion: 2.1 time: 0.053114 Sep 19 15:46:00.536827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1217/2322] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:00 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:01.229788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:01.230577 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:01.242792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:01.242792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:01.242792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:01.242792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:01.243422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:01.243422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:01.243422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=72 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:01.391416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:01.399422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-49ef8e1a-3fc8-4f4e-a109-c70f823f150e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.174681 Sep 19 15:46:01.399988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1106/2323] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:01 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:01.551274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ed623ee4-5c75-4da5-9fde-b0ef233947fe tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41fb086820>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:01.597977 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ed623ee4-5c75-4da5-9fde-b0ef233947fe tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 353 microversion: 2.1 time: 0.051189 Sep 19 15:46:01.598537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1218/2324] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:01 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:02.422368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:02.422925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:02.429330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:02.429816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:02.430257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:02.431079 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:02.431539 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:02.431968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:02.562419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:02.570118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0eb95a24-4547-4e7e-9de6-b3bad9db4abd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.151761 Sep 19 15:46:02.570681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1107/2325] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:02 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:02.613022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-2634b01a-0e19-45ad-8d44-52748d6710c9 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41fb0a5160>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:02.662710 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-2634b01a-0e19-45ad-8d44-52748d6710c9 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 353 microversion: 2.1 time: 0.053920 Sep 19 15:46:02.663268 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1219/2326] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:02 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:03.594122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:03.594706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:03.601809 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:03.602923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:03.603557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:03.604252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:03.604736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:03.605603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:03.677864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8460cf2f-dd0d-415a-917c-16daa166b28c tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41feb5e4c0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:03.735350 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8460cf2f-dd0d-415a-917c-16daa166b28c tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 353 microversion: 2.1 time: 0.061982 Sep 19 15:46:03.736131 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1220/2327] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:03 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:46:03.834397 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:03.845043 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9c8456ab-a2f8-4f48-859c-9f210ed1767f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.254906 Sep 19 15:46:03.845633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1108/2328] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:03 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:04.750735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a5902c93-90b5-4a4e-a787-32ea21d4f2e2 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41febe3160>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:04.801257 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a5902c93-90b5-4a4e-a787-32ea21d4f2e2 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 353 microversion: 2.1 time: 0.054913 Sep 19 15:46:04.801819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1221/2329] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:04 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:04.868541 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:04.869154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:04.875458 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:04.875932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:04.876363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:04.877338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:04.877783 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:04.878201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:05.009073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:05.016854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-18aa08cf-93cb-4b4b-9a62-5bcaa8921862 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.152301 Sep 19 15:46:05.017429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1109/2330] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:04 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:05.816215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bd4a1085-e79f-433f-92c4-da5a9692d251 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41fb0c8d30>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:05.865706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bd4a1085-e79f-433f-92c4-da5a9692d251 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 354 microversion: 2.1 time: 0.053884 Sep 19 15:46:05.866287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1222/2331] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:05 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:05.880233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c28d1f85-72ed-4eda-b01d-d5868048832a tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41fb453820>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:05.929633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c28d1f85-72ed-4eda-b01d-d5868048832a tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 354 microversion: 2.1 time: 0.053399 Sep 19 15:46:05.935236 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1110/2332] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:05 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:05.949931 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-37c86a6d-c321-4c9f-b1f2-a996d83f37bf tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41feb32820>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:06.040634 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:06.041237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:06.048072 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:06.048593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:06.049042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:06.049745 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:06.050206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:06.050638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:06.193222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:06.200044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-37c86a6d-c321-4c9f-b1f2-a996d83f37bf tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 202 len: 0 microversion: 2.1 time: 0.254770 Sep 19 15:46:06.200689 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1223/2333] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:46:05 2022] DELETE /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:46:06.201852 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0f8ec7aa-e83c-452b-9bce-2f19ec026a40 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.165225 Sep 19 15:46:06.205209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1111/2334] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:06 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:46:06.217510 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3126b427-5314-483a-be46-d2d64a1d5191 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41febe3160>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:06.282575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3126b427-5314-483a-be46-d2d64a1d5191 tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 200 len: 353 microversion: 2.1 time: 0.068816 Sep 19 15:46:06.287880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1224/2335] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:06 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:07.234490 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:07.235191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:07.241955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:07.242519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:07.243116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:07.243902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:07.245129 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:07.245625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:07.312959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8f4d525f-f620-4972-a555-8bf4b4a4918b tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Calling method '.version_select at 0x7f41feb5e4c0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:07.366913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-8f4d525f-f620-4972-a555-8bf4b4a4918b tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] HTTP exception thrown: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8f4d525f-f620-4972-a555-8bf4b4a4918b tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Request method failure captured: Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d HTTP/1.1 Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI63dq-Aq4aCklY9TF_ongz8NU2cOT2buF_1hYZbkchM4xSaqih2Bm0PTEHF4JWDXa_qhDaYNaHV-GqBns5vhjOK1PKpvspiSm8MnGU9OEqp1s2PgZiizAu2x9OrevaYHclxtCmsudfCkIwZnvj18TLLnCHWwoVfNHoyjqA2jI9p68Q Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: a8177f48f6c44e5f8072cefd26bbb1f4 Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesGetTestJSON-1034709739 Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:46:07.372922 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a8177f48f6c44e5f8072cefd26bbb1f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a8177f48f6c44e5f8072cefd26bbb1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a8177f48f6c44e5f8072cefd26bbb1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a8177f48f6c44e5f8072cefd26bbb1f4"}]}] Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesGetTestJSON-1034709739 Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: a8177f48f6c44e5f8072cefd26bbb1f4 Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesGetTestJSON-1034709739 Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesGetTestJSON-1034709739-project Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: c58dab81b6ed40b89a401463549add49 Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesGetTestJSON-1034709739-project Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d'} Sep 19 15:46:07.375509 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. (HTTP 404) (Request-ID: req-978ab6ee-62e2-4bd4-8e98-3bd297fb8de9) Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:07.376642 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:46:07.378980 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:46:07.380624 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8f4d525f-f620-4972-a555-8bf4b4a4918b tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] Returning 404 to user: Volume 1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8f4d525f-f620-4972-a555-8bf4b4a4918b tempest-VolumesGetTestJSON-1034709739 tempest-VolumesGetTestJSON-1034709739-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d" status: 404 len: 109 microversion: 2.1 time: 0.078251 Sep 19 15:46:07.384918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1225/2336] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:46:07 2022] GET /compute/v2.1/os-volumes/1e6846dc-f0a9-4d12-9aeb-49f58ab66c7d => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:46:07.402403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:07.410178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1f990c18-e6d7-4442-a2c6-0de4d1cb7461 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.179466 Sep 19 15:46:07.410715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1112/2337] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:07 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:08.435442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:08.437153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:08.443201 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:08.443907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:08.444429 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:08.445231 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:08.445793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:08.446291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:08.590278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:08.598586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1cdc0080-e78e-4e02-af41-0b1fcf94d4bb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.168906 Sep 19 15:46:08.599449 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1226/2338] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:08 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:09.637808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:09.638421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:09.645249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:09.645731 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:09.646158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:09.646843 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:09.647293 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:09.647702 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:09.781409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:09.789034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-66ab8356-9e97-486e-aac3-a5eccf55d502 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.156090 Sep 19 15:46:09.789597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1113/2339] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:09 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:10.812136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:10.812849 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:10.819272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:10.819777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:10.820208 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:10.820910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:10.821357 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:10.821769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:10.961177 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:10.968789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-32ffabb1-2fbc-4aa6-8807-8feaf0971ef0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.160520 Sep 19 15:46:10.969341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1227/2340] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:10 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:11.991206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:11.991808 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:11.999213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:11.999857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:12.000292 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:12.001352 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:12.001838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:12.002669 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:12.140768 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:12.148633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4f5cfc53-6fa2-4801-8372-1d7ddf768f87 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.161278 Sep 19 15:46:12.149192 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1114/2341] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:11 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:13.172129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:13.172763 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:13.179202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:13.179677 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:13.180559 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:13.181273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:13.182389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:13.182706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:13.314722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:13.322217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-474a3f54-74ea-4172-87d6-c643e405928c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.154388 Sep 19 15:46:13.322819 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1228/2342] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:13 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:14.345286 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:14.345926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:14.352388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:14.352874 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:14.353311 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:14.354627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:14.355169 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:14.355592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:14.493066 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:14.500763 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8d74f1db-3624-4166-b431-0920107bd2df tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.159359 Sep 19 15:46:14.506978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1115/2343] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:14 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:15.524853 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:15.526022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:15.533292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:15.533783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:15.534218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:15.534944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:15.535392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:15.535822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:15.727663 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:15.737725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fadad558-6120-4ddb-9d3b-b7d73eb67745 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.216835 Sep 19 15:46:15.738180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1229/2344] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:15 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:16.760749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:16.761414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:16.767681 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:16.768154 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:16.768622 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:16.769316 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:16.769758 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:16.770181 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:16.912075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:16.920863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-dca1d930-bb0a-4a05-9e72-865cb95a21ab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.164070 Sep 19 15:46:16.921576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1116/2345] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:16 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:46:17.175266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-43145e9d-5740-43a9-8f52-fec9b5438214 req-8ecae533-9a69-4663-8ff6-7538ae7af507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6166990c-0852-41cb-bb42-9ea385160606", "name": "network-vif-plugged", "status": "completed", "tag": "5d26d73b-042a-4dbf-8733-5d3b699dc0ed"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:17.185329 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-43145e9d-5740-43a9-8f52-fec9b5438214 req-8ecae533-9a69-4663-8ff6-7538ae7af507 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:17.185813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-43145e9d-5740-43a9-8f52-fec9b5438214 req-8ecae533-9a69-4663-8ff6-7538ae7af507 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:17.186246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-43145e9d-5740-43a9-8f52-fec9b5438214 req-8ecae533-9a69-4663-8ff6-7538ae7af507 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:17.197998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-43145e9d-5740-43a9-8f52-fec9b5438214 req-8ecae533-9a69-4663-8ff6-7538ae7af507 service nova] Creating event network-vif-plugged:5d26d73b-042a-4dbf-8733-5d3b699dc0ed for instance 6166990c-0852-41cb-bb42-9ea385160606 on hv-cinder-75671 Sep 19 15:46:17.203224 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-43145e9d-5740-43a9-8f52-fec9b5438214 req-8ecae533-9a69-4663-8ff6-7538ae7af507 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150389 Sep 19 15:46:17.203959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1230/2346] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:46:17.944878 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:17.945644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:17.953433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:17.954376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:17.954376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:17.955132 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:17.955591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:17.956016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:18.118559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:18.128889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4ec5114d-cb7f-44e8-8293-894a67f0ef78 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.188345 Sep 19 15:46:18.129970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1117/2347] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:17 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:19.167444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:19.168180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:19.174352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:19.175258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:19.175258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:19.175912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:19.176361 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:19.176810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:19.313744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:19.326053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8c591205-fe35-440d-9e42-8b227a017a57 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1368 microversion: 2.1 time: 0.162792 Sep 19 15:46:19.326758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1231/2348] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:19 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:20.349587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:20.350123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:20.357919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:20.357919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:20.359091 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:20.363968 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:20.364452 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:20.364922 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:20.498820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:46:20.506658 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7db7e571-7508-4e5a-980f-68d12aeb0372 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1558 microversion: 2.1 time: 0.161058 Sep 19 15:46:20.507862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1118/2349] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:46:20 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:46:20.532684 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:46:20.533367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:46:20.535724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=36 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:46:20.540593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:20.542437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:20.542437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:20.542437 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:20.542746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:20.543109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:20.620612 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-14786687-8a75-4963-bb83-166ba88d5cd2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091624 Sep 19 15:46:20.621210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1232/2350] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:46:20 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:46:21.917300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-c570f177-41b9-4ede-82f6-e8e50e9e3cb9 req-750f1907-b4fe-4e06-8ad9-5a9ca06f7a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6166990c-0852-41cb-bb42-9ea385160606", "tag": "5d26d73b-042a-4dbf-8733-5d3b699dc0ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:46:21.929359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c570f177-41b9-4ede-82f6-e8e50e9e3cb9 req-750f1907-b4fe-4e06-8ad9-5a9ca06f7a77 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:46:21.930071 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c570f177-41b9-4ede-82f6-e8e50e9e3cb9 req-750f1907-b4fe-4e06-8ad9-5a9ca06f7a77 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:46:21.930707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-c570f177-41b9-4ede-82f6-e8e50e9e3cb9 req-750f1907-b4fe-4e06-8ad9-5a9ca06f7a77 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:46:21.944719 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-c570f177-41b9-4ede-82f6-e8e50e9e3cb9 req-750f1907-b4fe-4e06-8ad9-5a9ca06f7a77 service nova] Creating event network-changed:5d26d73b-042a-4dbf-8733-5d3b699dc0ed for instance 6166990c-0852-41cb-bb42-9ea385160606 on hv-cinder-75671 Sep 19 15:46:21.950913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-c570f177-41b9-4ede-82f6-e8e50e9e3cb9 req-750f1907-b4fe-4e06-8ad9-5a9ca06f7a77 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037251 Sep 19 15:46:21.951508 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1119/2351] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:22.882199 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=59 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:22.882981 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:22.887173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1188239505", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452"}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:22.944039 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] validate_networks() for None {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:47:23.228976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:47:23.229436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:47:23.229915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:47:23.230326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:47:23.230741 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:47:23.239651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:23.240136 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:23.240604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:23.241343 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:23.241796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:23.242222 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:23.262445 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Getting quotas for project d46f08e4e89a4f6f88e82cfad5513aa5. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:47:23.267142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Getting quotas for user ae03e09576e44166a392b0965bc5be79 and project d46f08e4e89a4f6f88e82cfad5513aa5. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:47:23.283425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:47:23.285287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:47:23.397432 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1da69ad6-cdee-4e41-ba0b-7f2d8f584af9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517283 Sep 19 15:47:23.398086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1233/2352] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:47:23.407860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=39 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:23.408628 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=73 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:23.412990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ee8320b5-2318-43de-8c9c-e02aa304ec04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:23.413909 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ee8320b5-2318-43de-8c9c-e02aa304ec04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:23.474863 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ee8320b5-2318-43de-8c9c-e02aa304ec04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:23.484260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ee8320b5-2318-43de-8c9c-e02aa304ec04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1215 microversion: 2.1 time: 0.078336 Sep 19 15:47:23.485013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1120/2353] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:23 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:24.508880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cc2d47c0-d0f8-428b-ac4c-cfc8ec8b6649 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:24.509527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-cc2d47c0-d0f8-428b-ac4c-cfc8ec8b6649 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:24.565158 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-cc2d47c0-d0f8-428b-ac4c-cfc8ec8b6649 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:24.572607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cc2d47c0-d0f8-428b-ac4c-cfc8ec8b6649 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1215 microversion: 2.1 time: 0.068530 Sep 19 15:47:24.573152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1234/2354] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:24 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:25.596679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:25.597413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:25.604299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:25.604815 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:25.605248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:25.605943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:25.606388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:25.606807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:25.680640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:25.689835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-711d7876-20ed-4672-85ab-9edc7ef0fd68 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1267 microversion: 2.1 time: 0.098256 Sep 19 15:47:25.690487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1121/2355] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:25 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:26.713276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:26.713965 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:26.721129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:26.721610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:26.722037 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:26.722724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:26.723169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:26.723586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:26.839688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:26.847792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-17765917-797e-47b2-86a6-2e035af220f6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1273 microversion: 2.1 time: 0.138354 Sep 19 15:47:26.848604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1235/2356] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:26 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:27.871396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:27.872668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:27.880886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:27.881857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:27.882482 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:27.883358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:27.883990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:27.884631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:28.059760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:28.069869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d9d2baf7-cae0-4499-8d5c-46d57808ad37 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.200654 Sep 19 15:47:28.069869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1122/2357] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:27 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:28.410118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-336981f5-147e-42b6-a17f-b76a899140b4 req-dd97ab92-08fb-4fdf-8bab-d69a9341535b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426ada6d-bad2-4078-a169-5dbdc646ddab", "tag": "a64e869f-fba4-4e72-b6c8-a8cdc240d0d3"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:28.420544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-336981f5-147e-42b6-a17f-b76a899140b4 req-dd97ab92-08fb-4fdf-8bab-d69a9341535b service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:28.421334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-336981f5-147e-42b6-a17f-b76a899140b4 req-dd97ab92-08fb-4fdf-8bab-d69a9341535b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:28.422353 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-336981f5-147e-42b6-a17f-b76a899140b4 req-dd97ab92-08fb-4fdf-8bab-d69a9341535b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:28.435227 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-336981f5-147e-42b6-a17f-b76a899140b4 req-dd97ab92-08fb-4fdf-8bab-d69a9341535b service nova] Creating event network-changed:a64e869f-fba4-4e72-b6c8-a8cdc240d0d3 for instance 426ada6d-bad2-4078-a169-5dbdc646ddab on hv-cinder-75671 Sep 19 15:47:28.444574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-336981f5-147e-42b6-a17f-b76a899140b4 req-dd97ab92-08fb-4fdf-8bab-d69a9341535b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035077 Sep 19 15:47:28.444574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1236/2358] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:29.096094 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:29.096733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:29.103485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:29.103975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:29.104444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:29.105178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:29.105697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:29.106125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:29.236196 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:29.243893 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-beb0b136-d780-4ac3-b3f5-0d2e609b83e6 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.152515 Sep 19 15:47:29.244464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1123/2359] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:29 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:30.268050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:30.268850 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:30.275071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:30.275554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:30.275991 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:30.276756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:30.277211 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:30.277637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:30.414431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:30.422943 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-01312b16-49be-4d97-8ccb-5e577076ced8 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.158766 Sep 19 15:47:30.424866 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1237/2360] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:30 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:31.447657 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:31.448555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:31.455178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:31.455706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:31.457571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:31.457571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:31.457571 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:31.457988 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:31.690256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:31.698152 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-a68bf52e-a470-4ab6-a990-68c0c88492b2 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.254369 Sep 19 15:47:31.698722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1124/2361] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:31 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:32.722031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:32.722607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:32.729804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:32.730289 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:32.730724 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:32.731416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:32.731870 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:32.732291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:32.867334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:32.875964 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4e1684de-8858-4c11-8f89-68885c9c4098 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.157220 Sep 19 15:47:32.881604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1238/2362] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:32 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:33.898466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:33.899075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:33.901436 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:33.906911 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:33.907356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:33.907813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:33.908525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:33.908980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:33.909404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:34.038879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:34.046593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d9abbebb-ea63-4067-bfb4-06ce7cbc52a4 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.152231 Sep 19 15:47:34.047201 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1125/2363] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:33 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:35.077558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:35.077558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:35.077558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:35.077558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=8 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:47:35.081667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:35.082164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:35.082609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:35.083338 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:35.083792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:35.084279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:35.222920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:35.230583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3a37fc1d-9b7f-4ac1-930e-bc97ad29e6ae tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.165184 Sep 19 15:47:35.231138 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1239/2364] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:35 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:36.257022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:36.257637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:36.264646 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:36.265140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:36.265614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:36.266343 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:36.266798 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:36.267228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:36.406813 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:36.411931 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0c9c5ad5-2b38-468c-97da-07f52d4f35dc tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.159248 Sep 19 15:47:36.412865 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1126/2365] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:36 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:37.436433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:37.437176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:37.444790 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:37.445278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:37.445718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:37.446431 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:37.446887 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:37.447314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:37.587342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:37.598534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-94b8b3fb-6654-4529-a644-5d7917f6d5ed tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.166821 Sep 19 15:47:37.599282 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1240/2366] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:37 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:37.846603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-37acfa19-dd35-4f90-a840-e7f413e75bce req-13b7e670-85d4-48e2-9249-476e45f9787a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426ada6d-bad2-4078-a169-5dbdc646ddab", "name": "network-vif-plugged", "status": "completed", "tag": "a64e869f-fba4-4e72-b6c8-a8cdc240d0d3"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:37.857204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-37acfa19-dd35-4f90-a840-e7f413e75bce req-13b7e670-85d4-48e2-9249-476e45f9787a service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:37.857688 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-37acfa19-dd35-4f90-a840-e7f413e75bce req-13b7e670-85d4-48e2-9249-476e45f9787a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:37.858726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-37acfa19-dd35-4f90-a840-e7f413e75bce req-13b7e670-85d4-48e2-9249-476e45f9787a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:37.870733 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-37acfa19-dd35-4f90-a840-e7f413e75bce req-13b7e670-85d4-48e2-9249-476e45f9787a service nova] Creating event network-vif-plugged:a64e869f-fba4-4e72-b6c8-a8cdc240d0d3 for instance 426ada6d-bad2-4078-a169-5dbdc646ddab on hv-cinder-75671 Sep 19 15:47:37.876511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-37acfa19-dd35-4f90-a840-e7f413e75bce req-13b7e670-85d4-48e2-9249-476e45f9787a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034672 Sep 19 15:47:37.877673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1127/2367] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:47:38.622232 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:38.622929 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:38.629814 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:38.630311 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:38.630749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:38.631720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:38.632219 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:38.632687 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:38.786839 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:38.795472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d43b6ffc-32eb-4727-9f37-03e7534709fa tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.177314 Sep 19 15:47:38.796061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1241/2368] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:38 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:39.820252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:39.820942 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:39.827110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:39.827596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:39.828051 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:39.829439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:39.829896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:39.830330 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:39.959438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:39.967067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-43ae23de-d689-4903-892c-d0eaca9545e7 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1315 microversion: 2.1 time: 0.151574 Sep 19 15:47:39.967625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1128/2369] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:39 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:40.990084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:40.990643 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:40.997229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:40.997714 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:40.998153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:40.998845 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:40.999303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:40.999730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:41.138453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:41.146139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a27ca2e8-9242-428d-a95c-c8962bcc3169 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1464 microversion: 2.1 time: 0.160022 Sep 19 15:47:41.146695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1242/2370] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:40 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:41.192992 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:41.193495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:41.199806 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:41.200297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:41.200773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:41.201470 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:41.201927 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:41.202354 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:41.228215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:47:41.560749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-44f7cff5-453a-4619-8c75-8b98621aa5c9 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "DELETE /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 204 len: 0 microversion: 2.1 time: 0.370968 Sep 19 15:47:41.561342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1129/2371] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:47:41 2022] DELETE /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:47:41.569451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:41.570077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:41.576059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:41.576576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:41.577019 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:41.577717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:41.578238 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:41.578705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:41.710290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:41.718259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-da9e85e6-0eeb-4cdb-b4b3-6c407e91df91 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1470 microversion: 2.1 time: 0.152622 Sep 19 15:47:41.719442 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1243/2372] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:41 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:42.742706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:42.743414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:42.749875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:42.750412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:42.750872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:42.751570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:42.752057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:42.752516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:42.964526 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:42.973642 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3c415c63-2ff3-44c5-b89e-eebb1e059c04 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1470 microversion: 2.1 time: 0.235425 Sep 19 15:47:42.974216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1130/2373] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:42 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:43.803604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-ca0a4a48-a733-4cfc-a6db-844fdbe9140a req-dc34ee4a-e6e9-4d7d-850c-3c686d7a5042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426ada6d-bad2-4078-a169-5dbdc646ddab", "name": "network-vif-deleted", "tag": "a64e869f-fba4-4e72-b6c8-a8cdc240d0d3"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:47:43.813985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ca0a4a48-a733-4cfc-a6db-844fdbe9140a req-dc34ee4a-e6e9-4d7d-850c-3c686d7a5042 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:43.820184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ca0a4a48-a733-4cfc-a6db-844fdbe9140a req-dc34ee4a-e6e9-4d7d-850c-3c686d7a5042 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:43.820184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ca0a4a48-a733-4cfc-a6db-844fdbe9140a req-dc34ee4a-e6e9-4d7d-850c-3c686d7a5042 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:44.049533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-ca0a4a48-a733-4cfc-a6db-844fdbe9140a req-dc34ee4a-e6e9-4d7d-850c-3c686d7a5042 service nova] Creating event network-vif-deleted:a64e869f-fba4-4e72-b6c8-a8cdc240d0d3 for instance 426ada6d-bad2-4078-a169-5dbdc646ddab on hv-cinder-75671 Sep 19 15:47:44.049533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-ca0a4a48-a733-4cfc-a6db-844fdbe9140a req-dc34ee4a-e6e9-4d7d-850c-3c686d7a5042 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034224 Sep 19 15:47:44.049533 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1244/2374] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:47:44.050868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:44.050868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:44.050868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:44.050868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:44.051396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:44.051396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:44.051396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:44.051396 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:44.077868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae03e09576e44166a392b0965bc5be79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46f08e4e89a4f6f88e82cfad5513aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:47:44.086151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-93e8f3a7-ef5d-4cd9-b050-f1f55e667346 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 200 len: 1300 microversion: 2.1 time: 0.089017 Sep 19 15:47:44.089566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1131/2375] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:43 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:47:45.110706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:47:45.111412 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] [instance: 426ada6d-bad2-4078-a169-5dbdc646ddab] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:47:45.117554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:45.118086 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:45.118527 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:45.119225 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:47:45.119681 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:47:45.120109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:47:45.138975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] HTTP exception thrown: Instance 426ada6d-bad2-4078-a169-5dbdc646ddab could not be found. Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Request method failure captured: Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab HTTP/1.1 Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI8F1kZEkK1JwXjOmvuNHS6peFGsRkYjHU9nUJy3SPnMDKD0m2Va8sBaa31GMZIQ_Vly5JKs0T0qLyQYhH9XD8CXI-JtdZrLg2BNB1hB_dys24lMq0hV8WRMCd8cy8zhC0Du9ZVjCad746DAYyuMWuVw9XMmYCBntz6SebPuKDvUH2M Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: d46f08e4e89a4f6f88e82cfad5513aa5 Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesNegativeTest-1799285735 Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:47:45.141269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d46f08e4e89a4f6f88e82cfad5513aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d46f08e4e89a4f6f88e82cfad5513aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d46f08e4e89a4f6f88e82cfad5513aa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d46f08e4e89a4f6f88e82cfad5513aa5"}]}] Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesNegativeTest-1799285735 Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: d46f08e4e89a4f6f88e82cfad5513aa5 Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesNegativeTest-1799285735 Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesNegativeTest-1799285735-project Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: ae03e09576e44166a392b0965bc5be79 Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesNegativeTest-1799285735-project Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 426ada6d-bad2-4078-a169-5dbdc646ddab could not be found. Sep 19 15:47:45.142502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '426ada6d-bad2-4078-a169-5dbdc646ddab'} Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426ada6d-bad2-4078-a169-5dbdc646ddab could not be found. Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:47:45.143167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426ada6d-bad2-4078-a169-5dbdc646ddab could not be found. Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426ada6d-bad2-4078-a169-5dbdc646ddab could not be found. Sep 19 15:47:45.144376 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:47:45.145472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] Returning 404 to user: Instance 426ada6d-bad2-4078-a169-5dbdc646ddab could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:47:45.145472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-abb5e343-7c3a-416c-9ccd-3e5122077057 tempest-VolumesNegativeTest-1799285735 tempest-VolumesNegativeTest-1799285735-project] 10.222.0.75 "GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab" status: 404 len: 111 microversion: 2.1 time: 0.037024 Sep 19 15:47:45.145472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1245/2376] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:47:45 2022] GET /compute/v2.1/servers/426ada6d-bad2-4078-a169-5dbdc646ddab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:48:24.224089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-162342368", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "networks": [{"uuid": "6156a3f1-35d4-4445-872e-8d41bd0faa4b"}]}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:24.232580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:24.233277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:24.279059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] validate_networks() for [('6156a3f1-35d4-4445-872e-8d41bd0faa4b', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:48:24.652900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:48:24.653433 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:48:24.653913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:48:24.654323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:48:24.654765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:48:24.663802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:24.664280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:24.664741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:24.665466 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:24.665916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:24.666342 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:24.683245 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Getting quotas for project aa0d850d32ec44a298454aec53c823a5. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:48:24.687406 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Getting quotas for user 876cbb6dc8d147e78a8205b2eef241a4 and project aa0d850d32ec44a298454aec53c823a5. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:48:24.699430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:48:24.701762 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:48:24.872776 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bd1031fb-5015-4323-9a1d-ece743c676a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652798 Sep 19 15:48:24.873477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1132/2377] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:48:24.884913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fc71f07c-5246-4b10-bb2b-5bfe1d37e0ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:24.885535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fc71f07c-5246-4b10-bb2b-5bfe1d37e0ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:24.887810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:24.888574 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=56 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:24.942555 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fc71f07c-5246-4b10-bb2b-5bfe1d37e0ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:24.949508 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fc71f07c-5246-4b10-bb2b-5bfe1d37e0ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1213 microversion: 2.1 time: 0.068710 Sep 19 15:48:24.950073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1246/2378] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:24 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:25.078673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:25.079166 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:25.085469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:25.085980 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:25.086411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:25.087097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:25.087548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:25.087972 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:25.118191 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9f0920d6-a502-433f-8562-cc0c8e54ae7a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/ips" status: 200 len: 149 microversion: 2.1 time: 0.043402 Sep 19 15:48:25.118773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1133/2379] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:48:25 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:25.976758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a86df876-19e6-4ff1-a5e9-84314124ac4f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:25.976758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a86df876-19e6-4ff1-a5e9-84314124ac4f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:26.026953 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a86df876-19e6-4ff1-a5e9-84314124ac4f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:26.034808 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a86df876-19e6-4ff1-a5e9-84314124ac4f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1213 microversion: 2.1 time: 0.066532 Sep 19 15:48:26.035348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1247/2380] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:25 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:26.854116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a5b8ce-3396-43ab-a00a-14b6531d89ba"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:26.858478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:26.864134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:26.864637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:26.865067 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:26.865752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:26.866194 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:26.866610 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.057581 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:27.058116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:27.064636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.065125 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.065564 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.066255 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:27.067246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:27.067824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:27.144838 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:27.157179 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-75bd2ac7-7b1a-4bc9-bdcc-3fca2efe704e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1265 microversion: 2.1 time: 0.103236 Sep 19 15:48:27.158387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1248/2381] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:27 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:27.834488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-75be7b32-6e31-4ab0-a5e0-fd7a7983acfb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.983983 Sep 19 15:48:27.835134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1134/2382] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:48:26 2022] POST /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:28.180816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:28.181438 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:28.187777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:28.188265 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:28.188739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:28.189444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:28.189897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:28.190323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:28.425339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:28.433139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b92b4b5d-5e34-4a01-b82a-68cda63aad13 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.256316 Sep 19 15:48:28.433711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1249/2383] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:28 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:29.139753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-42e4163d-7bf2-4e27-a6b9-912810320101 req-8caacb13-32bc-49cd-b240-464f6798cb69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe85c94-2788-44a4-a0f8-ee6a2b5014a3", "tag": "5756065b-719c-4179-ab81-ec7a8090366f"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:29.150193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-42e4163d-7bf2-4e27-a6b9-912810320101 req-8caacb13-32bc-49cd-b240-464f6798cb69 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:29.150673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-42e4163d-7bf2-4e27-a6b9-912810320101 req-8caacb13-32bc-49cd-b240-464f6798cb69 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:29.151098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-42e4163d-7bf2-4e27-a6b9-912810320101 req-8caacb13-32bc-49cd-b240-464f6798cb69 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:29.161916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-42e4163d-7bf2-4e27-a6b9-912810320101 req-8caacb13-32bc-49cd-b240-464f6798cb69 service nova] Creating event network-changed:5756065b-719c-4179-ab81-ec7a8090366f for instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 on hv-cinder-75671 Sep 19 15:48:29.166467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-42e4163d-7bf2-4e27-a6b9-912810320101 req-8caacb13-32bc-49cd-b240-464f6798cb69 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031270 Sep 19 15:48:29.170444 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1135/2384] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:29.456961 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:29.458230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:29.464986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:29.465476 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:29.465918 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:29.466623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:29.467077 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:29.467497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:29.724386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:29.732180 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b6f87c3c-9329-4be4-a75e-dddd6cc652f6 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.279255 Sep 19 15:48:29.732789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1250/2385] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:29 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:30.758157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:30.758831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:30.765219 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:30.765716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:30.766143 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:30.766822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:30.767269 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:30.767687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:30.901385 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:30.908948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3185631e-d645-4553-93ba-d421f8a89f2e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.157180 Sep 19 15:48:30.909519 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1136/2386] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:30 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:31.931597 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:31.932210 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:31.938631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.939106 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.939540 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:31.940216 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:31.940690 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:31.941109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:32.068233 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:32.075937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-638de19b-a052-4257-9bd1-71103d6cf195 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.148254 Sep 19 15:48:32.076523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1251/2387] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:31 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:33.099986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:33.100671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:33.107084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:33.107574 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:33.108013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:33.108732 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:33.109189 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:33.109615 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:33.243263 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:33.250810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-eff3db17-bd52-4b51-99d0-aaec39c348a8 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.155415 Sep 19 15:48:33.251368 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1137/2388] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:33 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:34.274065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:34.274656 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:34.281134 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:34.281930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:34.282038 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:34.282709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:34.283155 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:34.283570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:34.412892 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:34.420665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f7287352-a63a-4b87-8b0c-1126238d6a02 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.150474 Sep 19 15:48:34.421229 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1252/2389] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:34 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:35.443644 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:35.444267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:35.446712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:35.447380 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:35.452149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:35.452682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:35.453123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:35.453823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:35.454282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:35.454710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:35.581975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:35.589779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bd23ebd3-88eb-4a1a-af1d-afcb0fb08efe tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.150163 Sep 19 15:48:35.590465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1138/2390] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:35 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:36.385284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-b41924c7-d6ba-4620-9ff0-b383fc2696eb req-ee2ea4af-e9a5-4c9e-af21-0b1701bcc4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe85c94-2788-44a4-a0f8-ee6a2b5014a3", "name": "network-vif-plugged", "status": "completed", "tag": "5756065b-719c-4179-ab81-ec7a8090366f"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:36.390251 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=4 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:36.394068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b41924c7-d6ba-4620-9ff0-b383fc2696eb req-ee2ea4af-e9a5-4c9e-af21-0b1701bcc4e3 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.394538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b41924c7-d6ba-4620-9ff0-b383fc2696eb req-ee2ea4af-e9a5-4c9e-af21-0b1701bcc4e3 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.395048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-b41924c7-d6ba-4620-9ff0-b383fc2696eb req-ee2ea4af-e9a5-4c9e-af21-0b1701bcc4e3 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.406184 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-b41924c7-d6ba-4620-9ff0-b383fc2696eb req-ee2ea4af-e9a5-4c9e-af21-0b1701bcc4e3 service nova] Creating event network-vif-plugged:5756065b-719c-4179-ab81-ec7a8090366f for instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 on hv-cinder-75671 Sep 19 15:48:36.411341 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-b41924c7-d6ba-4620-9ff0-b383fc2696eb req-ee2ea4af-e9a5-4c9e-af21-0b1701bcc4e3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Sep 19 15:48:36.411928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1253/2391] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:36.443405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a5b8ce-3396-43ab-a00a-14b6531d89ba"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:36.451112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:36.452259 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.452792 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.453224 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.453921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.454375 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.454807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.538835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Invalid volume: volume 09a5b8ce-3396-43ab-a00a-14b6531d89ba is already attached to instances: 6166990c-0852-41cb-bb42-9ea385160606 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: POST /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments HTTP/1.1 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 74 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:48:36.540591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {"volumeAttachment": {"volumeId": "09a5b8ce-3396-43ab-a00a-14b6531d89ba"}} Sep 19 15:48:36.549204 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid volume: volume 09a5b8ce-3396-43ab-a00a-14b6531d89ba is already attached to instances: 6166990c-0852-41cb-bb42-9ea385160606 Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': '6166990c-0852-41cb-bb42-9ea385160606', 'body': {'volumeAttachment': {'volumeId': '09a5b8ce-3396-43ab-a00a-14b6531d89ba'}}} Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 09a5b8ce-3396-43ab-a00a-14b6531d89ba is already attached to instances: 6166990c-0852-41cb-bb42-9ea385160606 Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:36.550209 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 09a5b8ce-3396-43ab-a00a-14b6531d89ba is already attached to instances: 6166990c-0852-41cb-bb42-9ea385160606 Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:36.551872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 09a5b8ce-3396-43ab-a00a-14b6531d89ba is already attached to instances: 6166990c-0852-41cb-bb42-9ea385160606 Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 400 to user: Invalid volume: volume 09a5b8ce-3396-43ab-a00a-14b6531d89ba is already attached to instances: 6166990c-0852-41cb-bb42-9ea385160606 {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6137d222-a7a5-4504-8021-556521d95994 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103343 Sep 19 15:48:36.552887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1139/2392] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:48:36 2022] POST /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:48:36.613141 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:36.613340 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:36.614287 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:36.614449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:36.620372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.620514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.620900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.621033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.621340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.621454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.622040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.622150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.622495 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.622627 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.622923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.623025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.707279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 6166990c-0852-41cb-bb42-9ea385160606 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:48:36.772332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:36.783098 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e9395658-71d8-415a-a498-02a5657138f2 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.173757 Sep 19 15:48:36.783663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1140/2393] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:36 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:36.920880 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4e20583b-bfd5-4005-a3d4-4ce2e4119288 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments/09a5b8ce-3396-43ab-a00a-14b6531d89ba" status: 202 len: 0 microversion: 2.1 time: 0.312396 Sep 19 15:48:36.921488 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1254/2394] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:48:36 2022] DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments/09a5b8ce-3396-43ab-a00a-14b6531d89ba => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:48:36.930287 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:36.932587 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:36.938506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.939019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.939429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.940088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:36.940558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:36.940978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:36.971005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0dcdf5a9-7ed2-4648-89dd-fbe38b0dd29b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Sep 19 15:48:36.971753 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1141/2395] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:48:36 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:37.808069 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:37.808799 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:37.815008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:37.815498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:37.815962 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:37.817188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:37.817873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:37.818303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:37.948950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:37.956644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7f5d4f4d-a0d6-44c1-9c6e-4a5646694547 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.153276 Sep 19 15:48:37.957205 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1255/2396] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:37 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:37.983592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:37.985832 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:37.992819 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:37.993300 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:37.993740 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:37.994428 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:37.994887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:37.995312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:38.024962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ac69e7ba-82c2-43c7-ac4f-d36ab743b093 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Sep 19 15:48:38.025517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1142/2397] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:48:37 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:38.979835 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:38.980454 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:38.987188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:38.987672 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:38.988196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:38.989036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:38.989499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:38.989924 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.038422 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:39.040835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:39.047525 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.048010 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.048451 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.049195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.049827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.050249 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.081729 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-aff5da29-8ea0-4c89-bc5f-26c5807b3565 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048141 Sep 19 15:48:39.082283 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1143/2398] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:48:39 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:48:39.126855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:39.141196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a9a56339-a43b-401f-8820-74202d1b66c4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1313 microversion: 2.1 time: 0.165267 Sep 19 15:48:39.142006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1256/2399] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:38 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:39.152802 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:39.153315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:39.159358 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.159840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.160277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.162999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.163485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.164389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.191280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:48:39.514991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1341d2fb-a1bd-40f4-acf9-64451b5ae25c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 204 len: 0 microversion: 2.1 time: 0.365839 Sep 19 15:48:39.515595 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1144/2400] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:48:39 2022] DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:48:39.523607 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:39.524243 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:39.530192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.530660 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.531087 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.531757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:39.532200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:39.532645 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:39.664278 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:39.671937 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-aac57daf-a66c-4b59-adc6-90415f47000f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1682 microversion: 2.1 time: 0.152142 Sep 19 15:48:39.672506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1257/2401] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:39 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:40.166389 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:40.167103 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:40.173534 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:40.174049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:40.174487 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:40.175195 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:40.175639 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:40.176075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:40.302961 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:40.310486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-2ba4bd6a-499c-4ddf-a35d-2a917775b79a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1498 microversion: 2.1 time: 0.148342 Sep 19 15:48:40.311038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1145/2402] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:40 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:40.695867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:40.696406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:40.702884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:40.703367 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:40.703805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:40.704514 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:40.704972 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:40.705397 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:40.846727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:40.854749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a18e365b-ca7a-492e-bfc7-e2d5265543b8 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1682 microversion: 2.1 time: 0.163388 Sep 19 15:48:40.855310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1258/2403] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:40 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:41.075131 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:41.075629 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:41.081641 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.082121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.082627 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.083511 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.083964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.084394 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.108178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:48:41.122241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:41.384868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-daef3d3d-9225-45c3-8280-bc47e345393a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 204 len: 0 microversion: 2.1 time: 0.312964 Sep 19 15:48:41.385599 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1146/2404] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:48:41 2022] DELETE /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:48:41.393648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:41.394290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:41.400364 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.400884 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.401314 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.402760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.403221 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.403644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.539428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:41.547433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-235bfe8a-3412-4526-9001-b8286d34cdb4 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1504 microversion: 2.1 time: 0.157648 Sep 19 15:48:41.547997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1259/2405] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:41 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:41.879034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:41.879736 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:41.885910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.886384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.886811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:41.887488 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:41.887934 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:41.888367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:42.168020 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:42.175701 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-e6559ce2-ad5a-42aa-9c0d-d9962ea8dccb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1682 microversion: 2.1 time: 0.300893 Sep 19 15:48:42.176884 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1147/2406] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:41 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:42.571978 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:42.572640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:42.579447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:42.579928 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:42.580363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:42.581083 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:42.581536 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:42.585798 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:42.803196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:42.811152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8d1e52f8-d182-499b-92c1-b3193be1253e tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1504 microversion: 2.1 time: 0.243595 Sep 19 15:48:42.811900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1260/2407] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:42 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:43.199412 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:43.200084 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:43.208217 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:43.208730 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:43.209162 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:43.209869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:43.210317 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:43.210734 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:43.510145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:43.517772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0766dd3b-f1dc-4302-8f7b-d656e82f42a6 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1682 microversion: 2.1 time: 0.322242 Sep 19 15:48:43.518319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1148/2408] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:43 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1682 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:43.835061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:43.835686 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:43.842890 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:43.843987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:43.845036 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:43.845983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:43.846640 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:43.847284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:43.929134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-e1e9cad8-22ac-4799-9f4f-21464d36ede5 req-84a13e09-47ac-48ea-8472-323a51767b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6166990c-0852-41cb-bb42-9ea385160606", "name": "network-vif-deleted", "tag": "5d26d73b-042a-4dbf-8733-5d3b699dc0ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:43.941157 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-e1e9cad8-22ac-4799-9f4f-21464d36ede5 req-84a13e09-47ac-48ea-8472-323a51767b44 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:43.942023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-e1e9cad8-22ac-4799-9f4f-21464d36ede5 req-84a13e09-47ac-48ea-8472-323a51767b44 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:43.944213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-e1e9cad8-22ac-4799-9f4f-21464d36ede5 req-84a13e09-47ac-48ea-8472-323a51767b44 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:43.955761 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:43.963153 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-e1e9cad8-22ac-4799-9f4f-21464d36ede5 req-84a13e09-47ac-48ea-8472-323a51767b44 service nova] Creating event network-vif-deleted:5d26d73b-042a-4dbf-8733-5d3b699dc0ed for instance 6166990c-0852-41cb-bb42-9ea385160606 on hv-cinder-75671 Sep 19 15:48:43.970196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d8a1908a-9ae2-493c-8659-39bfdfa21f26 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1462 microversion: 2.1 time: 0.139163 Sep 19 15:48:43.971127 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-e1e9cad8-22ac-4799-9f4f-21464d36ede5 req-84a13e09-47ac-48ea-8472-323a51767b44 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048515 Sep 19 15:48:43.972138 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1149/2409] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:43.985756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1261/2410] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:43 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1462 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:44.542530 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:44.543353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:44.551827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:44.551827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:44.551827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:44.551827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:44.552710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:44.553008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:44.585399 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:44.586149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:44.586581 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:44.587062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'fault' on Instance uuid 6166990c-0852-41cb-bb42-9ea385160606 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:48:44.641556 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:44.650205 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-69fb0af7-e851-4cc5-b436-eb0ec59ead42 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 200 len: 1332 microversion: 2.1 time: 0.112340 Sep 19 15:48:44.650773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1150/2411] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:44 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:44.996959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:44.997576 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:45.005394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:45.005885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:45.006328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:45.007042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:45.007494 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:45.007930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:45.040380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:45.040816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:45.041248 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:45.041692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lazy-loading 'fault' on Instance uuid 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:48:45.081549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:45.089189 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5b3ec9e3-0950-460f-a0d4-911b2f6aead9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 200 len: 1303 microversion: 2.1 time: 0.096556 Sep 19 15:48:45.089745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1262/2412] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:44 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:45.674229 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:45.674839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:45.681323 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:45.681796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:45.682231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:45.682924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:45.683367 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:45.683789 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:45.697253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 HTTP/1.1 Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:48:45.698870 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:48:45.699948 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '6166990c-0852-41cb-bb42-9ea385160606'} Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:48:45.700649 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:48:45.701794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:48:45.702829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:48:45.702829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b540d377-cecd-4060-9ffc-e70049f9b2fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 404 len: 111 microversion: 2.1 time: 0.029981 Sep 19 15:48:45.702829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1151/2413] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:45 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:48:45.709804 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0e4f39c9-313d-40e9-9821-134bd9e1d25b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '.version_select at 0x7f41feb5e1f0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:45.786415 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0e4f39c9-313d-40e9-9821-134bd9e1d25b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621921576" status: 202 len: 0 microversion: 2.1 time: 0.080975 Sep 19 15:48:45.787028 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1263/2414] 10.222.0.75 () {58 vars in 1221 bytes} [Mon Sep 19 15:48:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621921576 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:48:45.991638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-5c6a8c75-b813-4507-b4a8-fce6993ab0b1 req-2f61503b-2b91-49f3-bb44-1bd84ed74e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe85c94-2788-44a4-a0f8-ee6a2b5014a3", "name": "network-vif-deleted", "tag": "5756065b-719c-4179-ab81-ec7a8090366f"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:46.001594 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-5c6a8c75-b813-4507-b4a8-fce6993ab0b1 req-2f61503b-2b91-49f3-bb44-1bd84ed74e76 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:46.002228 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-5c6a8c75-b813-4507-b4a8-fce6993ab0b1 req-2f61503b-2b91-49f3-bb44-1bd84ed74e76 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:46.002671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-5c6a8c75-b813-4507-b4a8-fce6993ab0b1 req-2f61503b-2b91-49f3-bb44-1bd84ed74e76 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:46.021075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-5c6a8c75-b813-4507-b4a8-fce6993ab0b1 req-2f61503b-2b91-49f3-bb44-1bd84ed74e76 service nova] Creating event network-vif-deleted:5756065b-719c-4179-ab81-ec7a8090366f for instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 on hv-cinder-75671 Sep 19 15:48:46.021075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-5c6a8c75-b813-4507-b4a8-fce6993ab0b1 req-2f61503b-2b91-49f3-bb44-1bd84ed74e76 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Sep 19 15:48:46.021075 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1152/2415] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:46.116113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:46.116874 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:46.123416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:46.123979 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:46.124538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:46.125296 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:46.125847 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:46.126339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:46.141198 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] HTTP exception thrown: Instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 could not be found. Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Request method failure captured: Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 HTTP/1.1 Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI9GRdOwIKCMt9jPE63U_iIu4ydyfT7Vo0YMTCEAbsRctUvWwaroV1KxcZeYlfJ8RRHrt2BxlNTsirqiYUv1YHDZAHy68ni-iiCU76S0l6CjTKmJgi5PNLaVdS3cDtl3iC1Dy34-nh4Yjbi_J1Yeg7BYQaMoN6DyKRGq5PF_SOrOyZU Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: aa0d850d32ec44a298454aec53c823a5 Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesActionsTest-520807406 Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:48:46.142867 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa0d850d32ec44a298454aec53c823a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aa0d850d32ec44a298454aec53c823a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa0d850d32ec44a298454aec53c823a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aa0d850d32ec44a298454aec53c823a5"}]}] Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesActionsTest-520807406 Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: aa0d850d32ec44a298454aec53c823a5 Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesActionsTest-520807406 Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesActionsTest-520807406-project Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 876cbb6dc8d147e78a8205b2eef241a4 Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesActionsTest-520807406-project Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 could not be found. Sep 19 15:48:46.145416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '5fe85c94-2788-44a4-a0f8-ee6a2b5014a3'} Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 could not be found. Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:48:46.146259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 could not be found. Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 could not be found. Sep 19 15:48:46.148413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:48:46.150856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Returning 404 to user: Instance 5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:48:46.150856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6b189dcd-f5a8-4333-a61e-da572b6ec902 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3" status: 404 len: 111 microversion: 2.1 time: 0.033026 Sep 19 15:48:46.150856 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1264/2416] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:46 2022] GET /compute/v2.1/servers/5fe85c94-2788-44a4-a0f8-ee6a2b5014a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:48:46.201937 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2111356334", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "networks": [{"uuid": "6156a3f1-35d4-4445-872e-8d41bd0faa4b"}]}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:46.255962 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] validate_networks() for [('6156a3f1-35d4-4445-872e-8d41bd0faa4b', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:48:46.545959 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d4f74999-6893-4525-aef0-83a47f344586 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: .version_select at 0x7f41fb0864c0>, body: {"keypair": {"name": "tempest-keypair-1425948516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZZ+MNJGRzr3cDHT5PZwkjsvZHgyj2I4+MP3mp1owURyCbf4KVGS4E8ok9YL3FfaB1uAhywM6b+z5h1OJL8TvNa0QnaxlNa1PaxzcwSy4rE2xqW5+TsNMZ2TRNLpQ1FaQ=="}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:46.562745 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-d4f74999-6893-4525-aef0-83a47f344586 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:48:46.568577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-d4f74999-6893-4525-aef0-83a47f344586 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'key_pairs'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:48:46.611580 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:48:46.612003 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:48:46.612499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:48:46.612936 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:48:46.613347 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:48:46.622591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:46.623078 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:46.623557 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:46.624285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:46.624748 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:46.625179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:46.642633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Getting quotas for project aa0d850d32ec44a298454aec53c823a5. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:48:46.646906 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Getting quotas for user 876cbb6dc8d147e78a8205b2eef241a4 and project aa0d850d32ec44a298454aec53c823a5. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:48:46.658280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:48:46.660814 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:48:46.677848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d4f74999-6893-4525-aef0-83a47f344586 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135896 Sep 19 15:48:46.678447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1265/2417] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:48:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:46.775623 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6a52dbcc-d536-48a2-bfe8-c5b21f1efa5a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577757 Sep 19 15:48:46.776840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1153/2418] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:48:46.789464 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0349c239-72ce-4347-8c0e-98655bfb13dd tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:46.792197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0349c239-72ce-4347-8c0e-98655bfb13dd tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:46.852785 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0349c239-72ce-4347-8c0e-98655bfb13dd tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:46.861888 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0349c239-72ce-4347-8c0e-98655bfb13dd tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1214 microversion: 2.1 time: 0.077497 Sep 19 15:48:46.862511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1266/2419] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:46 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:47.886338 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:47.886895 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:47.894033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:47.894514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:47.894950 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:47.895651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:47.896237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:47.896774 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:47.956858 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:47.965052 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d0d0ce90-a2ea-40bc-8097-c237bafeb937 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1218 microversion: 2.1 time: 0.083766 Sep 19 15:48:47.965621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1154/2420] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:47 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:48.987455 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:48.988071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:48.995774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:48.996249 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:48.996718 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:48.997418 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:48.997966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:48.998616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:49.060151 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1389032461", "imageRef": "5a712f41-b33e-4895-b999-224a23446986", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117"}], "security_groups": [{"name": "tempest-securitygroup--1324634790"}], "key_name": "tempest-keypair-1425948516", "user_data": "}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:49.077012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:49.081253 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:49.087258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b7c6e837-3f46-4ce8-919a-455c5a330c5f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1274 microversion: 2.1 time: 0.103951 Sep 19 15:48:49.099490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1267/2421] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:48 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:49.190915 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.network.neutron [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] validate_networks() for [('bfa0e431-a67a-4ff1-9a5e-d6d5a30eb117', None, None, None, None, None)] {{(pid=121177) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:48:50.060137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:48:50.060604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image limits 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:48:50.061160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Flavor pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:48:50.061597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Image pref 0:0:0 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:48:50.062015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.virt.hardware [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:48:50.072233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:50.072756 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:50.073197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:50.073930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:50.074384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:50.074810 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:50.091531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:48:50.095203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Getting quotas for user fb7200a9769b46b3a79c9fe6287a1724 and project 13d5af34cdc54fd8be3b076c629e2cbd. Resources: {'cores', 'ram', 'instances'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:48:50.097602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:50.107820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Going to run 1 instances... {{(pid=121177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:48:50.110065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5a712f41-b33e-4895-b999-224a23446986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:48:50.110792 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:50.111560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:50.119202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:50.124592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:50.124592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:50.124592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:50.124592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:50.124960 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:50.225951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9cf37c4b-877e-4d36-9b30-b1f8b19b642b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.171696 Sep 19 15:48:50.232879 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1155/2422] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:48:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:48:50.237839 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7796818d-c4a0-488e-970b-c297cccc6be2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:50.238459 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7796818d-c4a0-488e-970b-c297cccc6be2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:50.320653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7796818d-c4a0-488e-970b-c297cccc6be2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:50.330023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7796818d-c4a0-488e-970b-c297cccc6be2 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1242 microversion: 2.1 time: 0.096038 Sep 19 15:48:50.330675 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1156/2423] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:50 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:50.348011 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:50.356300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3971064f-d975-4834-9f08-064bb7e44221 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.249949 Sep 19 15:48:50.356900 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1268/2424] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:50 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:51.222652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-38c808a6-404c-498a-814e-aa81eb7381e1 req-fe6fb19b-3387-4d26-88ca-9e76efa07a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57ad70d-dbc1-4c70-b472-365b383d22ef", "tag": "a5432a90-c05f-41a5-a285-e421e6696901"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:51.229640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-38c808a6-404c-498a-814e-aa81eb7381e1 req-fe6fb19b-3387-4d26-88ca-9e76efa07a18 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:51.230122 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-38c808a6-404c-498a-814e-aa81eb7381e1 req-fe6fb19b-3387-4d26-88ca-9e76efa07a18 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:51.230586 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-38c808a6-404c-498a-814e-aa81eb7381e1 req-fe6fb19b-3387-4d26-88ca-9e76efa07a18 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:51.246420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-38c808a6-404c-498a-814e-aa81eb7381e1 req-fe6fb19b-3387-4d26-88ca-9e76efa07a18 service nova] Creating event network-changed:a5432a90-c05f-41a5-a285-e421e6696901 for instance e57ad70d-dbc1-4c70-b472-365b383d22ef on hv-cinder-75671 Sep 19 15:48:51.251720 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-38c808a6-404c-498a-814e-aa81eb7381e1 req-fe6fb19b-3387-4d26-88ca-9e76efa07a18 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036953 Sep 19 15:48:51.252378 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1157/2425] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:48:51.839636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:51.839636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:51.839636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:51.839636 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:51.842165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:51.842165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:51.842165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:51.842165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:51.842603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:51.842603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:51.842603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:51.842603 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:51.842872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:51.842872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:51.842872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:51.842872 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:51.843215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:51.843215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-fae72065-2c4f-4ea0-a45d-02ccce18feab tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1246 microversion: 2.1 time: 0.107723 Sep 19 15:48:51.843215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1269/2426] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:51 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:51.843413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:51.843413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-93b426e1-1258-47a4-bf55-13facc5cf67a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.243316 Sep 19 15:48:51.843413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1158/2427] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:51 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:48:52.479436 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:52.479974 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:52.486426 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:52.495762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:52.495762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:52.495762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:52.495762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:52.496113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:52.552092 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:52.560043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bbe79561-f2f5-4b6f-a659-1c66dadb06fd tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1294 microversion: 2.1 time: 0.084559 Sep 19 15:48:52.560662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1270/2428] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:52 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:52.642621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:52.643227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:52.649667 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:52.650148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:52.650578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:52.651255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:52.651705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:52.652123 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:52.779337 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:52.787077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9b0ec1f5-d166-403d-9e94-9911656195fa tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.148719 Sep 19 15:48:52.787626 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1159/2429] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:52 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:53.583352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:53.583983 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:53.590447 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:53.590923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:53.591351 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:53.592033 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:53.592519 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:53.592942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:53.655256 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:53.662869 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-02cb219b-9db2-4dd9-b8ac-646b21dea877 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1294 microversion: 2.1 time: 0.083527 Sep 19 15:48:53.663428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1271/2430] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:53 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:53.810582 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:53.811197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:53.817772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:53.818250 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:53.818685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:53.819376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:53.819826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:53.820253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:53.948016 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:53.955697 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-33bcae04-0d48-44e9-96b5-8f66bbfd8e35 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.149300 Sep 19 15:48:53.956257 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1160/2431] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:53 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:54.685915 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:54.686530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:54.693565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:54.694046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:54.694481 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:54.695169 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:54.695631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:54.696051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:54.910044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:54.917976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bb905c5b-5aff-4d9c-b4b0-061695b7bfd3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1294 microversion: 2.1 time: 0.235941 Sep 19 15:48:54.918531 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1272/2432] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:54 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:54.978013 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:54.978638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:54.985290 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:54.985775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:54.986216 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:54.986916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:54.987365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:54.987811 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:55.183206 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:55.191465 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4291978c-42dc-42a4-b6f1-e3e8a0adbf04 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.217308 Sep 19 15:48:55.192928 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1161/2433] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:54 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:55.941336 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:55.941942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:55.948873 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:55.951390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:55.951390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:55.951390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:55.951390 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:55.951722 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:56.146388 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:56.154450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-05a6fef1-0d78-44aa-ae20-5a24cf5e2ef7 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.216892 Sep 19 15:48:56.155012 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1273/2434] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:55 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:56.216034 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:56.217826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:56.227267 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:56.227755 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:56.228413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:56.231889 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:56.232384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:56.232854 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:56.323939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-284f3902-8ff4-4957-8809-06abfd9e95d2 req-aadb4367-13ff-48eb-ba0d-017268549fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57ad70d-dbc1-4c70-b472-365b383d22ef", "name": "network-vif-plugged", "status": "completed", "tag": "a5432a90-c05f-41a5-a285-e421e6696901"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:56.333315 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:56.335757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-284f3902-8ff4-4957-8809-06abfd9e95d2 req-aadb4367-13ff-48eb-ba0d-017268549fce service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:56.336300 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-284f3902-8ff4-4957-8809-06abfd9e95d2 req-aadb4367-13ff-48eb-ba0d-017268549fce service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:56.336813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-284f3902-8ff4-4957-8809-06abfd9e95d2 req-aadb4367-13ff-48eb-ba0d-017268549fce service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:56.347837 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-284f3902-8ff4-4957-8809-06abfd9e95d2 req-aadb4367-13ff-48eb-ba0d-017268549fce service nova] Creating event network-vif-plugged:a5432a90-c05f-41a5-a285-e421e6696901 for instance e57ad70d-dbc1-4c70-b472-365b383d22ef on hv-cinder-75671 Sep 19 15:48:56.353764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-284f3902-8ff4-4957-8809-06abfd9e95d2 req-aadb4367-13ff-48eb-ba0d-017268549fce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033938 Sep 19 15:48:56.358113 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1274/2435] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:56.469430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:56.476916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-14c01eaf-377d-4f35-ac47-a0e84f46f3ba tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.265564 Sep 19 15:48:56.477485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1162/2436] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:56 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:57.107760 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=6 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:48:57.112433 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-3dec2a4e-ab45-4a04-9ed5-c4879b720f8f req-674a0a7a-59cf-4adc-bfcd-9be610dc394e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e50a3a7-1505-482c-ba59-15edb7400d06", "tag": "ff4e1db7-89be-48e9-9f28-6e32338b52c3"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:48:57.122465 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-3dec2a4e-ab45-4a04-9ed5-c4879b720f8f req-674a0a7a-59cf-4adc-bfcd-9be610dc394e service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:57.125505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-3dec2a4e-ab45-4a04-9ed5-c4879b720f8f req-674a0a7a-59cf-4adc-bfcd-9be610dc394e service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:57.125505 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-3dec2a4e-ab45-4a04-9ed5-c4879b720f8f req-674a0a7a-59cf-4adc-bfcd-9be610dc394e service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:57.133973 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-3dec2a4e-ab45-4a04-9ed5-c4879b720f8f req-674a0a7a-59cf-4adc-bfcd-9be610dc394e service nova] Creating event network-changed:ff4e1db7-89be-48e9-9f28-6e32338b52c3 for instance 8e50a3a7-1505-482c-ba59-15edb7400d06 on hv-cinder-75671 Sep 19 15:48:57.138917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-3dec2a4e-ab45-4a04-9ed5-c4879b720f8f req-674a0a7a-59cf-4adc-bfcd-9be610dc394e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032025 Sep 19 15:48:57.139495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1275/2437] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:48:57.178464 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:57.179258 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:57.185388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:57.185886 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:57.186332 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:57.187030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:57.187485 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:57.187913 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:57.404593 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:57.413030 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8ab72c63-d7fe-4b64-a177-bbd4d8081a22 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.238598 Sep 19 15:48:57.417231 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1163/2438] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:57 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:57.501022 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:57.501742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:57.509143 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:57.514537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:57.514537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:57.514537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:57.514537 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:57.514939 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:57.645909 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:57.654191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-13ca714b-f194-46ab-8e3b-1eed540f1efb tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.157782 Sep 19 15:48:57.654736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1276/2439] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:57 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:58.435472 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:58.436120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:58.442576 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:58.443063 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:58.443502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:58.444190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:58.444687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:58.445116 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:58.623643 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:58.631521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-84270c9a-0308-4c15-98e7-53662a37de30 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.199848 Sep 19 15:48:58.632331 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1164/2440] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:58 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:58.676371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:58.677054 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:58.683406 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:58.683896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:58.684333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:58.685061 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:58.685538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:58.686044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:58.819333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:58.827031 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c415ff46-09d1-477b-8882-b7df9273590f tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1314 microversion: 2.1 time: 0.154685 Sep 19 15:48:58.827589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1277/2441] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:58 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:59.655097 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:59.655705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:59.662241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:59.662723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:59.663214 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:59.663908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:59.664356 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:59.664822 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:59.811056 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:59.818679 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-44c502f5-cab0-4a6c-abb4-776fffcc6602 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.167461 Sep 19 15:48:59.819232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1165/2442] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:59 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:48:59.850703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:48:59.851318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:48:59.857771 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:59.858250 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:59.858688 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:59.859403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:48:59.859857 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:48:59.860281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:48:59.986905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:48:59.995511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-95ef8147-5853-4543-b184-34087519d37a tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1498 microversion: 2.1 time: 0.149240 Sep 19 15:48:59.996070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1278/2443] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:48:59 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:00.800788 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:00.801285 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:00.803796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=4 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:00.804449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=14 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:00.809578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:00.810059 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:00.810494 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:00.811176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:00.811625 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:00.812047 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:00.837480 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:49:00.840242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:00.841568 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:00.842176 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:00.848044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:00.849142 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:00.849669 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:00.850359 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:00.850823 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:00.851335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:00.982968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:00.990616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-718c45c2-181e-4d32-8453-4d88f7ff0ebb tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.152801 Sep 19 15:49:00.991109 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1279/2444] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:00 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:49:01.085752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6e2f409b-8a12-446f-a0cb-f0e0e7968c6c tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 204 len: 0 microversion: 2.1 time: 0.288389 Sep 19 15:49:01.086355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1166/2445] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:49:00 2022] DELETE /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:49:01.094789 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:01.095482 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:01.102140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:01.102615 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:01.103042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:01.103733 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:01.104166 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:01.104631 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:01.233425 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:01.242695 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0ac457a3-cf1a-46d0-a2c4-0f667b418370 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1504 microversion: 2.1 time: 0.151618 Sep 19 15:49:01.243191 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1280/2446] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:01 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:02.013381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:02.014088 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:02.021302 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:02.021784 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:02.022225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:02.022912 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:02.023364 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:02.023786 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:02.156607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:02.165226 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b0c79e5d-e408-4a23-89fd-b34c0341413d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.156375 Sep 19 15:49:02.165782 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1167/2447] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:02 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:02.267044 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:02.267871 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:02.274467 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:02.274950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:02.275385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:02.276080 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:02.276560 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:02.276986 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:02.407126 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:02.415571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8e6d5e70-6c2f-4050-9d5c-1c6aa404ec8b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1504 microversion: 2.1 time: 0.152473 Sep 19 15:49:02.416188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1281/2448] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:02 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:03.189089 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:03.189851 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:03.197234 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:03.197721 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:03.198159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:03.198850 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:03.199301 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:03.199726 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:03.378823 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:03.390310 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-748b390f-6d77-42f4-ad1a-a6a9284a95b9 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.205025 Sep 19 15:49:03.390892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1168/2449] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:03 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:03.438762 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:03.439369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:03.445910 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:03.446394 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:03.446825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:03.447512 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:03.447963 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:03.448380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:03.628533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-7f54d02e-81b9-4897-883a-5b2b44d4e91c req-ab0f712d-e5ae-4cbf-9d36-b035d7cbe5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57ad70d-dbc1-4c70-b472-365b383d22ef", "name": "network-vif-deleted", "tag": "a5432a90-c05f-41a5-a285-e421e6696901"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:03.640816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-7f54d02e-81b9-4897-883a-5b2b44d4e91c req-ab0f712d-e5ae-4cbf-9d36-b035d7cbe5c3 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:03.641561 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-7f54d02e-81b9-4897-883a-5b2b44d4e91c req-ab0f712d-e5ae-4cbf-9d36-b035d7cbe5c3 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:03.642203 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-7f54d02e-81b9-4897-883a-5b2b44d4e91c req-ab0f712d-e5ae-4cbf-9d36-b035d7cbe5c3 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:03.655822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:03.657372 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-7f54d02e-81b9-4897-883a-5b2b44d4e91c req-ab0f712d-e5ae-4cbf-9d36-b035d7cbe5c3 service nova] Creating event network-vif-deleted:a5432a90-c05f-41a5-a285-e421e6696901 for instance e57ad70d-dbc1-4c70-b472-365b383d22ef on hv-cinder-75671 Sep 19 15:49:03.662507 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-7f54d02e-81b9-4897-883a-5b2b44d4e91c req-ab0f712d-e5ae-4cbf-9d36-b035d7cbe5c3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039049 Sep 19 15:49:03.663567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1169/2450] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:49:03.663826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-11fa3c09-9c96-4a07-b9a4-5607552184b9 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1504 microversion: 2.1 time: 0.228838 Sep 19 15:49:03.664391 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1282/2451] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:03 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:04.324031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-509dfabf-9883-4bf1-9248-977af9e2aa75 req-6eb35426-f3e2-49cf-81d0-e8ce432c0939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e50a3a7-1505-482c-ba59-15edb7400d06", "name": "network-vif-plugged", "status": "completed", "tag": "ff4e1db7-89be-48e9-9f28-6e32338b52c3"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:04.334183 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-509dfabf-9883-4bf1-9248-977af9e2aa75 req-6eb35426-f3e2-49cf-81d0-e8ce432c0939 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:04.334651 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-509dfabf-9883-4bf1-9248-977af9e2aa75 req-6eb35426-f3e2-49cf-81d0-e8ce432c0939 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:04.335111 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-509dfabf-9883-4bf1-9248-977af9e2aa75 req-6eb35426-f3e2-49cf-81d0-e8ce432c0939 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:04.345796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-509dfabf-9883-4bf1-9248-977af9e2aa75 req-6eb35426-f3e2-49cf-81d0-e8ce432c0939 service nova] Creating event network-vif-plugged:ff4e1db7-89be-48e9-9f28-6e32338b52c3 for instance 8e50a3a7-1505-482c-ba59-15edb7400d06 on hv-cinder-75671 Sep 19 15:49:04.350743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-509dfabf-9883-4bf1-9248-977af9e2aa75 req-6eb35426-f3e2-49cf-81d0-e8ce432c0939 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031311 Sep 19 15:49:04.356145 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1170/2452] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:49:04.414173 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:04.414796 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:04.421297 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:04.421698 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:04.422135 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:04.422855 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:04.423309 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:04.423730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:04.561998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:04.570896 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a9709fc8-da42-4caa-aa7d-9f93cd8b7012 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.161006 Sep 19 15:49:04.571480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1283/2453] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:04 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:04.691340 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:04.692105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:04.698441 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:04.698930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:04.699419 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:04.700119 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:04.700608 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:04.701049 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:04.737440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:04.738044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:04.738484 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:04.738970 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lazy-loading 'fault' on Instance uuid e57ad70d-dbc1-4c70-b472-365b383d22ef {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:49:04.794179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876cbb6dc8d147e78a8205b2eef241a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0d850d32ec44a298454aec53c823a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:04.803083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7b43b760-f8d8-4a87-9315-615037a1aa5b tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 200 len: 1304 microversion: 2.1 time: 0.115986 Sep 19 15:49:04.803668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1171/2454] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:04 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:05.594335 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:05.594970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:05.601558 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:05.602032 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:05.602461 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:05.603140 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:05.603589 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:05.604003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:05.741616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:05.749373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-79e73641-a9a6-4d9f-8f14-f2221af5b75a tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1368 microversion: 2.1 time: 0.158889 Sep 19 15:49:05.749950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1284/2455] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:05 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:05.827037 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:05.827652 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] [instance: e57ad70d-dbc1-4c70-b472-365b383d22ef] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:05.834312 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:05.834794 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:05.835232 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:05.835920 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:05.836371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:05.836820 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:05.850351 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] HTTP exception thrown: Instance e57ad70d-dbc1-4c70-b472-365b383d22ef could not be found. Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Request method failure captured: Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef HTTP/1.1 Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKI9GRdOwIKCMt9jPE63U_iIu4ydyfT7Vo0YMTCEAbsRctUvWwaroV1KxcZeYlfJ8RRHrt2BxlNTsirqiYUv1YHDZAHy68ni-iiCU76S0l6CjTKmJgi5PNLaVdS3cDtl3iC1Dy34-nh4Yjbi_J1Yeg7BYQaMoN6DyKRGq5PF_SOrOyZU Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: aa0d850d32ec44a298454aec53c823a5 Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesActionsTest-520807406 Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:49:05.851981 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa0d850d32ec44a298454aec53c823a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aa0d850d32ec44a298454aec53c823a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa0d850d32ec44a298454aec53c823a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aa0d850d32ec44a298454aec53c823a5"}]}] Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesActionsTest-520807406 Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: aa0d850d32ec44a298454aec53c823a5 Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesActionsTest-520807406 Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesActionsTest-520807406-project Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 876cbb6dc8d147e78a8205b2eef241a4 Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesActionsTest-520807406-project Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance e57ad70d-dbc1-4c70-b472-365b383d22ef could not be found. Sep 19 15:49:05.853439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'e57ad70d-dbc1-4c70-b472-365b383d22ef'} Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57ad70d-dbc1-4c70-b472-365b383d22ef could not be found. Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:49:05.854235 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57ad70d-dbc1-4c70-b472-365b383d22ef could not be found. Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57ad70d-dbc1-4c70-b472-365b383d22ef could not be found. Sep 19 15:49:05.855533 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:49:05.856686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] Returning 404 to user: Instance e57ad70d-dbc1-4c70-b472-365b383d22ef could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:49:05.856686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4e8151d5-5f43-4be7-9ab4-756743085804 tempest-VolumesActionsTest-520807406 tempest-VolumesActionsTest-520807406-project] 10.222.0.75 "GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef" status: 404 len: 111 microversion: 2.1 time: 0.030411 Sep 19 15:49:05.856686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1172/2456] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:05 2022] GET /compute/v2.1/servers/e57ad70d-dbc1-4c70-b472-365b383d22ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:49:06.775604 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:06.780694 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:06.782334 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:06.783194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:06.783312 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:06.784132 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:06.784610 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:06.785041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:06.921200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:49:06.924754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=100 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:49:06.929940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a60e3766-4551-487e-bdce-03cf286897e1 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1558 microversion: 2.1 time: 0.161265 Sep 19 15:49:06.930502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1285/2457] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:49:06 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:49:06.952678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:49:06.953163 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:49:06.959559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:06.960095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:06.960565 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:06.961261 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:06.961717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:06.962147 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:07.039678 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-467145fe-1a91-45e7-9d48-055e2b11b102 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090842 Sep 19 15:49:07.040405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1173/2458] 10.222.0.75 () {58 vars in 1275 bytes} [Mon Sep 19 15:49:06 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:49:08.322274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-ddfc5d5c-36c2-42ca-b6d6-c29e3288fc09 req-d1661e54-9fce-4070-a84e-d1de2d6db20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e50a3a7-1505-482c-ba59-15edb7400d06", "tag": "ff4e1db7-89be-48e9-9f28-6e32338b52c3"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:49:08.332267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ddfc5d5c-36c2-42ca-b6d6-c29e3288fc09 req-d1661e54-9fce-4070-a84e-d1de2d6db20b service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:49:08.333493 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ddfc5d5c-36c2-42ca-b6d6-c29e3288fc09 req-d1661e54-9fce-4070-a84e-d1de2d6db20b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:49:08.333998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-ddfc5d5c-36c2-42ca-b6d6-c29e3288fc09 req-d1661e54-9fce-4070-a84e-d1de2d6db20b service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:49:08.345544 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-ddfc5d5c-36c2-42ca-b6d6-c29e3288fc09 req-d1661e54-9fce-4070-a84e-d1de2d6db20b service nova] Creating event network-changed:ff4e1db7-89be-48e9-9f28-6e32338b52c3 for instance 8e50a3a7-1505-482c-ba59-15edb7400d06 on hv-cinder-75671 Sep 19 15:49:08.351046 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-ddfc5d5c-36c2-42ca-b6d6-c29e3288fc09 req-d1661e54-9fce-4070-a84e-d1de2d6db20b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032747 Sep 19 15:49:08.351652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1286/2459] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:03.684529 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 15:50:03.686213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Mon Sep 19 15:50:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.75) !!! Sep 19 15:50:03.686213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:03.686447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:03.690514 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3d72a01-7d71-4a56-b870-0aed8b34c52c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Action: 'create', calling method: .version_select at 0x7f41fb453af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-327351449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqOh5OMOX9j5FRV0fxUbrgJZUbGOa9P6qmJSCHN4FTzYDRM+4rneB0pQhJl3cAsEQ8C3h9Ciy3bycuJTkHx5JBWB+BS5CP28OKMz087mtM0j7nRngiwK5HNpQI6mvrsdg=="}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:03.708430 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-d3d72a01-7d71-4a56-b870-0aed8b34c52c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Getting quotas for project abac9835b5dd48248ba4f7d77ea8d7f5. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:50:03.713112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.quota [None req-d3d72a01-7d71-4a56-b870-0aed8b34c52c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Getting quotas for user a4a0d76fa5a54a729b0e4862a6c88de7 and project abac9835b5dd48248ba4f7d77ea8d7f5. Resources: {'key_pairs'} {{(pid=121177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:50:03.805038 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3d72a01-7d71-4a56-b870-0aed8b34c52c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.123147 Sep 19 15:50:03.805862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1174/2460] 10.222.0.75 () {60 vars in 1159 bytes} [Mon Sep 19 15:50:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:50:03.856416 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:50:03.856975 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Mon Sep 19 15:50:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.75) !!! Sep 19 15:50:03.857738 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=25 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:03.858623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:03.862779 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1238886857", "imageRef": "e6b09502-ddb3-472a-bd87-d2b0b1f3bceb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-327351449", "networks": [{"uuid": "9dd241f1-bd98-498a-bf3a-cc26f612079c"}]}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:03.915824 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.network.neutron [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] validate_networks() for [('9dd241f1-bd98-498a-bf3a-cc26f612079c', None, None, None, None, None)] {{(pid=121178) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:50:04.390185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Flavor limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:50:04.390611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Image limits 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:50:04.391090 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Flavor pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:50:04.391499 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Image pref 0:0:0 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:50:04.391912 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.virt.hardware [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:50:04.401303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.401490 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.401930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.402662 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:04.403118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:04.403543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:04.420381 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Getting quotas for project abac9835b5dd48248ba4f7d77ea8d7f5. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:50:04.424450 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.quota [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Getting quotas for user a4a0d76fa5a54a729b0e4862a6c88de7 and project abac9835b5dd48248ba4f7d77ea8d7f5. Resources: {'cores', 'ram', 'instances'} {{(pid=121178) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:50:04.436050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Going to run 1 instances... {{(pid=121178) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:50:04.438744 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6b09502-ddb3-472a-bd87-d2b0b1f3bceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121178) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:50:04.583822 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-863edcd7-201e-4457-bd45-0384f1e2a5d3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729340 Sep 19 15:50:04.584497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1287/2461] 10.222.0.75 () {60 vars in 1147 bytes} [Mon Sep 19 15:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 15:50:04.596172 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c1bff872-5fae-45e3-8f91-787e56b04a1c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:04.596842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c1bff872-5fae-45e3-8f91-787e56b04a1c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:04.658891 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c1bff872-5fae-45e3-8f91-787e56b04a1c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:04.666359 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c1bff872-5fae-45e3-8f91-787e56b04a1c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1258 microversion: 2.1 time: 0.074615 Sep 19 15:50:04.666932 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1175/2462] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:04 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:50:05.690088 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b0b23ad7-c80f-43d6-b222-e0f8e0d57e35 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:05.690735 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b0b23ad7-c80f-43d6-b222-e0f8e0d57e35 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:05.746244 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-b0b23ad7-c80f-43d6-b222-e0f8e0d57e35 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:05.755506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b0b23ad7-c80f-43d6-b222-e0f8e0d57e35 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1258 microversion: 2.1 time: 0.069519 Sep 19 15:50:05.756124 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1288/2463] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:05 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:06.779137 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:06.779752 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:06.786297 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:06.786779 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:06.787213 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:06.787902 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:06.788411 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:06.788866 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:06.849638 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:06.857771 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-59778377-4f5d-47a1-9615-ba4070531f5c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1310 microversion: 2.1 time: 0.082496 Sep 19 15:50:06.858479 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1176/2464] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:06 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:07.881369 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:07.882319 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:07.901492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:07.902331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:07.902999 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:07.904276 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:07.905004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:07.905648 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:08.113940 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:08.155266 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6d4940bd-390a-4853-9dde-d6c6d31dd6f0 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.272342 Sep 19 15:50:08.157269 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1289/2465] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:07 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:09.194408 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:09.195031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:09.202096 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:09.202578 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:09.203011 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:09.203706 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:09.204160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:09.204614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:09.519807 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:09.528125 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-af07e85a-b4ee-4ed2-bc8f-a775d46f1797 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.337576 Sep 19 15:50:09.528716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1177/2466] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:09 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:10.552014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:10.552579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:10.559933 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:10.560404 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:10.561035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:10.561730 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:10.562185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:10.562608 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:10.694585 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:10.703107 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-4a7d5ef0-b683-42c8-af23-03bbd874d357 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.154971 Sep 19 15:50:10.703864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1290/2467] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:10 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:11.730930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:11.731551 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:11.738198 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:11.738923 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:11.739548 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:11.740423 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:11.741050 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:11.741636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:11.902008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:11.909502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4d913504-23fb-489a-aa8c-c52c4b21bbff tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.182865 Sep 19 15:50:11.918139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1178/2468] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:11 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:12.933740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:12.934342 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:12.941766 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:12.942242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:12.942715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:12.943419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:12.943854 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:12.944396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:13.083444 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:13.094506 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-f4d63b59-0b50-47d3-aa1f-9226323246cc tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.165245 Sep 19 15:50:13.095286 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1291/2469] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:12 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:14.119738 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:14.120506 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:14.127161 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:14.127650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:14.128335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:14.137057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:14.137057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:14.137057 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:14.305670 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:14.313860 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-d3e263d8-bad9-49e1-a495-ca24637a40b4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.198603 Sep 19 15:50:14.314438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1179/2470] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:14 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:15.340277 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:15.341139 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:15.348530 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=2 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:15.350715 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:15.351272 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:15.351782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:15.353042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:15.353500 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:15.353920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:15.491451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:15.502657 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3918d3ed-0b3d-4756-8402-a7c4a9813d3d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.167801 Sep 19 15:50:15.503308 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1292/2471] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:15 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:16.527722 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:16.528438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:16.530478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=6 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:16.535715 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:16.536225 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:16.536723 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:16.537414 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:16.537862 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:16.538282 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:16.676360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:16.691387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-1eeb6baa-686f-46e7-ab14-fc9a4f83ee4a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.167980 Sep 19 15:50:16.692023 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1180/2472] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:16 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:17.715290 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:17.715897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:17.718068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell0:SELECT=8 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:17.723389 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:17.723864 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:17.724295 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:17.725004 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:17.725453 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:17.725868 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:17.858307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:17.865917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-8bd5dbef-c521-469f-bd3f-1121ffcd010a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.154716 Sep 19 15:50:17.866472 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1293/2473] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:17 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:18.890377 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:18.891001 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:18.897486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:18.897966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:18.898404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:18.899093 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:18.900159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:18.900621 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:19.029975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:19.035827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-9cbde119-8cad-4b95-b923-20fd2e204ad8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.149598 Sep 19 15:50:19.036381 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1181/2474] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:18 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:20.059386 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:20.059930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:20.066448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:20.066930 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:20.067366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:20.068372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:20.068858 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:20.069285 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:20.214196 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:20.223571 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3dff721d-05e1-401c-a4cc-72d38c3e15b2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.168564 Sep 19 15:50:20.224392 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1294/2475] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:20 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:21.247793 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:21.253930 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:21.254772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:21.255248 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:21.255686 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:21.256360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:21.256831 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:21.257252 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:21.471028 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:21.479604 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-877f4c6f-1ea2-43a0-8114-c565bc7abc74 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.236029 Sep 19 15:50:21.480405 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1182/2476] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:21 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:22.503586 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:22.504263 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:22.511034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:22.511561 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:22.512003 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:22.512749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:22.513206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:22.513897 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:22.779944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:22.787658 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-583cda41-a38e-441a-8663-0f8dd27f9bc6 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.288091 Sep 19 15:50:22.788618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1295/2477] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:22 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:22.889838 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-117962df-4564-4fb7-92f4-d7d0f258f1c5 req-d4f4b7c4-94c0-484d-b5d8-e0ec963d9098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:22.900461 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-117962df-4564-4fb7-92f4-d7d0f258f1c5 req-d4f4b7c4-94c0-484d-b5d8-e0ec963d9098 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:22.900983 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-117962df-4564-4fb7-92f4-d7d0f258f1c5 req-d4f4b7c4-94c0-484d-b5d8-e0ec963d9098 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:22.901417 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-117962df-4564-4fb7-92f4-d7d0f258f1c5 req-d4f4b7c4-94c0-484d-b5d8-e0ec963d9098 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:22.912254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-117962df-4564-4fb7-92f4-d7d0f258f1c5 req-d4f4b7c4-94c0-484d-b5d8-e0ec963d9098 service nova] Creating event network-changed:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:50:22.917749 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-117962df-4564-4fb7-92f4-d7d0f258f1c5 req-d4f4b7c4-94c0-484d-b5d8-e0ec963d9098 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031945 Sep 19 15:50:22.918409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1183/2478] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:23.810997 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:23.811614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:23.818079 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.818557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.818989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.819676 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:23.820129 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:23.820579 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:23.957611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:23.966813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-c6244be0-f645-43ce-bd1e-cd8943247f7d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.159652 Sep 19 15:50:23.967379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1296/2479] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:23 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:24.991344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:24.992053 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:24.999065 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:24.999543 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:24.999984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:25.000713 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:25.001170 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:25.001598 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:25.132073 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:25.140158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-23fba723-b557-4a35-a9bd-0b3836305a00 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.153601 Sep 19 15:50:25.140760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1184/2480] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:24 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:26.163716 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:26.164325 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:26.170976 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:26.171475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:26.171905 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:26.172606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:26.173052 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:26.173469 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:26.300655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:26.309599 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3da3b4cb-2b50-40ea-a905-c4ce2b70b716 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.149730 Sep 19 15:50:26.310283 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1297/2481] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:26 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:27.332391 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:27.333033 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:27.340355 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:27.340871 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:27.341339 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:27.342035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:27.342523 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:27.342946 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:27.476027 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:27.483653 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4ff48d8c-5e0b-4c83-b48e-058cff87c32a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.155136 Sep 19 15:50:27.484223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1185/2482] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:27 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:28.506756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:28.507363 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:28.514157 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:28.514634 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:28.515065 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:28.515739 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:28.516215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:28.516659 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:28.681644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:28.681644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ab344375-832d-4b95-9e9d-f681c7cc20c3 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.157423 Sep 19 15:50:28.681644 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1298/2483] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:28 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:28.842835 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-466f6f4b-2909-4cfa-b857-bc54e74c4aa5 req-067caec9-7740-4eed-a19a-36f703abd5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "name": "network-vif-plugged", "status": "completed", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:28.854916 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-466f6f4b-2909-4cfa-b857-bc54e74c4aa5 req-067caec9-7740-4eed-a19a-36f703abd5ef service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:28.855388 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-466f6f4b-2909-4cfa-b857-bc54e74c4aa5 req-067caec9-7740-4eed-a19a-36f703abd5ef service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:28.855816 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-466f6f4b-2909-4cfa-b857-bc54e74c4aa5 req-067caec9-7740-4eed-a19a-36f703abd5ef service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:28.866447 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-466f6f4b-2909-4cfa-b857-bc54e74c4aa5 req-067caec9-7740-4eed-a19a-36f703abd5ef service nova] Creating event network-vif-plugged:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:50:28.872158 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-466f6f4b-2909-4cfa-b857-bc54e74c4aa5 req-067caec9-7740-4eed-a19a-36f703abd5ef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Sep 19 15:50:28.872707 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1186/2484] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:29.684679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:29.685653 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:29.694259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:29.694259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:29.694259 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:29.694598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:29.694754 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:29.695170 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:29.838594 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:29.846217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6689a639-4e5c-480d-bf29-ef8b12c6a1cd tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1358 microversion: 2.1 time: 0.166711 Sep 19 15:50:29.846777 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1299/2485] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:29 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:30.871036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:30.871761 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:30.877908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:30.878365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:30.878791 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:30.879467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:30.879910 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:30.880328 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.009315 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:31.017743 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7bbc0396-be85-4f82-a04c-8a1e64acd313 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1548 microversion: 2.1 time: 0.152614 Sep 19 15:50:31.018306 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1187/2486] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:30 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:31.040711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:31.041252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:31.047598 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.048070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.048522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.049200 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.049652 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.050070 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.178807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:31.187188 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-84fa6d39-61b1-41ab-99cd-eb4fa62516e9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1548 microversion: 2.1 time: 0.150439 Sep 19 15:50:31.187749 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1300/2487] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:31 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:31.209197 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:31.213978 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:31.214741 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Searching by: {'deleted': False, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5'} {{(pid=121177) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 15:50:31.221321 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.221804 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.222241 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.222965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.223421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.223846 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.313505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.multi_cell_list [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121177) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 15:50:31.415284 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ac4b6646-62be-4172-bcbc-e9013e1dc385 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209712 Sep 19 15:50:31.415855 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1188/2488] 10.222.0.75 () {58 vars in 1125 bytes} [Mon Sep 19 15:50:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:50:31.427758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:31.428371 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:31.435084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.435554 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.435987 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.436703 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:31.437153 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:31.437573 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:31.567951 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:31.576434 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9a4048bb-2bfa-4dc6-a111-e9a54d1ee477 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1548 microversion: 2.1 time: 0.152653 Sep 19 15:50:31.577009 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1301/2489] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:31 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:33.436319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4fef7f3-a480-4d84-b820-1264d9dea96f"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:33.438676 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:33.444975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:33.445448 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:33.445877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:33.446553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:33.446998 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:33.447415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:34.204898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ea2b1022-71b1-4743-b117-365b34c17b5d tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772330 Sep 19 15:50:34.205502 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1189/2490] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:50:33 2022] POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:34.811025 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:34.811543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:34.813913 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:34.818651 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:34.819133 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:34.819570 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:34.820258 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:34.820740 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:34.821167 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:34.823529 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=81 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:34.844751 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-43bed300-0ce6-4216-be54-531419285d9e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/ips" status: 200 len: 149 microversion: 2.1 time: 0.038302 Sep 19 15:50:34.845320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1302/2491] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:50:34 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:36.489042 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8516c4a3-5e7f-40a8-9d28-9ccda4922969"}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:36.491605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:36.493553 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:36.499620 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.500090 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.500559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:36.501255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:36.501712 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:36.502212 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:37.094973 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:37.287365 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6eb9f953-0e99-479f-9427-5faee5f2c119 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "POST /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803180 Sep 19 15:50:37.288022 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1190/2492] 10.222.0.75 () {60 vars in 1323 bytes} [Mon Sep 19 15:50:36 2022] POST /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:41.886989 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:41.887609 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:41.895091 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:41.895563 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:41.895998 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:41.896717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:41.897163 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:41.897583 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:42.032073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:42.040322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-d29d1abf-9734-4a79-91a8-acbd4e64cd79 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1594 microversion: 2.1 time: 0.157951 Sep 19 15:50:42.040927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1303/2493] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:41 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:43.993516 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell0:SELECT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:50:44.063415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-acc58f9a-50cf-44c9-920c-f07a941b00dc req-e054118a-8789-497e-9632-2ba8b23f0ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:44.073242 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-acc58f9a-50cf-44c9-920c-f07a941b00dc req-e054118a-8789-497e-9632-2ba8b23f0ebd service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:44.073703 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-acc58f9a-50cf-44c9-920c-f07a941b00dc req-e054118a-8789-497e-9632-2ba8b23f0ebd service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:44.074387 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-acc58f9a-50cf-44c9-920c-f07a941b00dc req-e054118a-8789-497e-9632-2ba8b23f0ebd service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:44.085062 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-acc58f9a-50cf-44c9-920c-f07a941b00dc req-e054118a-8789-497e-9632-2ba8b23f0ebd service nova] Creating event network-changed:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:50:44.090591 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-acc58f9a-50cf-44c9-920c-f07a941b00dc req-e054118a-8789-497e-9632-2ba8b23f0ebd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098294 Sep 19 15:50:44.091329 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1191/2494] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:46.797753 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1693805130"}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:46.798281 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:46.804920 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:46.806534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:46.806534 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:46.806720 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:46.807041 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:46.808072 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:46.935279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.network.security_group_api [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Adding security group c5d3d474-7da4-4e69-9c42-52c5c13efb2b to port f5fa2195-4ec0-4ed6-9dca-08155365f6ed Sep 19 15:50:47.303377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b1d77a61-59e3-44b0-ab28-16eb35ae3a8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/action" status: 202 len: 0 microversion: 2.1 time: 0.505465 Sep 19 15:50:47.303377 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1304/2495] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:50:46 2022] POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:50:47.310954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:47.312454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:47.321139 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:47.321984 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:47.322663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:47.325173 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:47.325869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:47.326475 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:47.383757 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-52ee3be5-a918-4af8-9cf2-8c547658682a req-95cfd061-729e-4b9a-a59b-ca3f52d4a64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:47.395637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-52ee3be5-a918-4af8-9cf2-8c547658682a req-95cfd061-729e-4b9a-a59b-ca3f52d4a64a service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:47.396246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-52ee3be5-a918-4af8-9cf2-8c547658682a req-95cfd061-729e-4b9a-a59b-ca3f52d4a64a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:47.396810 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-52ee3be5-a918-4af8-9cf2-8c547658682a req-95cfd061-729e-4b9a-a59b-ca3f52d4a64a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:47.409543 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-52ee3be5-a918-4af8-9cf2-8c547658682a req-95cfd061-729e-4b9a-a59b-ca3f52d4a64a service nova] Creating event network-changed:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:50:47.415667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-52ee3be5-a918-4af8-9cf2-8c547658682a req-95cfd061-729e-4b9a-a59b-ca3f52d4a64a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107061 Sep 19 15:50:47.416443 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1305/2496] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:47.492182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:47.501036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-69ea2d45-e4d1-442f-bd21-8df60ee13af9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1760 microversion: 2.1 time: 0.195433 Sep 19 15:50:47.501619 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1192/2497] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:47 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1760 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:49.383764 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:49.384667 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:49.391366 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.391842 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.392593 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.393279 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.393727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.394148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.531475 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'services' on Instance uuid 8e50a3a7-1505-482c-ba59-15edb7400d06 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:50:49.764320 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b3f005fa-d6ad-4e60-a5f8-81cb5b4b192c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments/8516c4a3-5e7f-40a8-9d28-9ccda4922969" status: 202 len: 0 microversion: 2.1 time: 0.384893 Sep 19 15:50:49.765165 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1306/2498] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:50:49 2022] DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments/8516c4a3-5e7f-40a8-9d28-9ccda4922969 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:50:49.773696 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:49.775960 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:49.782463 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.782965 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.783384 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.784077 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:49.784558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:49.785008 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:49.817517 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-4564e2dc-a1ed-4c5f-8a89-11d5ddd4b49b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Sep 19 15:50:49.818074 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1193/2499] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:50:49 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:50.831551 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:50.834008 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:50.840202 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:50.840719 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:50.841156 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:50.841834 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:50.842291 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:50.842711 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:50.871903 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-086efc71-f25e-4b75-a248-e7439ad3ea09 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045235 Sep 19 15:50:50.872451 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1307/2500] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:50:50 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:50:50.935935 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:50.936416 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:50.942805 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:50.943291 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:50.943728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:50.944418 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:50.944908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:50.945335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:50.971176 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Going to try to terminate instance {{(pid=121177) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:50:51.241924 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7274faa3-a413-47b8-acb8-351c6ede7b69 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 204 len: 0 microversion: 2.1 time: 0.310353 Sep 19 15:50:51.242432 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1194/2501] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:50 2022] DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:50:51.250863 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:51.251480 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:51.257435 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:51.257916 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:51.258349 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:51.259034 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:51.259491 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:51.259911 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:51.389402 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:51.397385 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-3fe75efe-dc9c-4aa4-8a8b-525f4b2eb0a0 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1682 microversion: 2.1 time: 0.150450 Sep 19 15:50:51.397942 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1308/2502] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:51 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:52.421379 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:52.422083 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:52.428613 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:52.429126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:52.429569 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:52.430254 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:52.430705 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:52.431126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:52.566847 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:52.575055 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-c5cf97da-fc23-4a3b-9050-e793374481b4 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1682 microversion: 2.1 time: 0.158261 Sep 19 15:50:52.580584 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1195/2503] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:52 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:53.598661 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:53.599303 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:53.605725 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:53.606247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:53.606679 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:53.607372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:53.607813 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:53.608306 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:53.852970 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:53.860618 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ac054047-5560-435c-af6e-c6501dec2dfc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1682 microversion: 2.1 time: 0.265840 Sep 19 15:50:53.861396 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1309/2504] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:53 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:54.379764 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-8cac3351-22a6-463e-99fb-afbb4ccf10c8 req-2bcb3221-6916-473f-baf1-4a9200d6edda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e50a3a7-1505-482c-ba59-15edb7400d06", "name": "network-vif-deleted", "tag": "ff4e1db7-89be-48e9-9f28-6e32338b52c3"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:50:54.386692 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-8cac3351-22a6-463e-99fb-afbb4ccf10c8 req-2bcb3221-6916-473f-baf1-4a9200d6edda service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.387179 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-8cac3351-22a6-463e-99fb-afbb4ccf10c8 req-2bcb3221-6916-473f-baf1-4a9200d6edda service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.388233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-8cac3351-22a6-463e-99fb-afbb4ccf10c8 req-2bcb3221-6916-473f-baf1-4a9200d6edda service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.399796 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-8cac3351-22a6-463e-99fb-afbb4ccf10c8 req-2bcb3221-6916-473f-baf1-4a9200d6edda service nova] Creating event network-vif-deleted:ff4e1db7-89be-48e9-9f28-6e32338b52c3 for instance 8e50a3a7-1505-482c-ba59-15edb7400d06 on hv-cinder-75671 Sep 19 15:50:54.405099 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-8cac3351-22a6-463e-99fb-afbb4ccf10c8 req-2bcb3221-6916-473f-baf1-4a9200d6edda service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Sep 19 15:50:54.406036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1196/2505] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:50:54.884014 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:54.884898 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:54.892192 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.892811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.893409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.894128 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.894606 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.895026 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.928215 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:54.928746 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:54.929185 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:54.929637 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lazy-loading 'fault' on Instance uuid 8e50a3a7-1505-482c-ba59-15edb7400d06 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:50:54.969966 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb7200a9769b46b3a79c9fe6287a1724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d5af34cdc54fd8be3b076c629e2cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:50:54.977670 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-bd55e86d-19ec-4408-81fc-c638cc7f4b8b tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 200 len: 1332 microversion: 2.1 time: 0.097644 Sep 19 15:50:54.978239 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1310/2506] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:54 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:50:56.003471 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:56.004182 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:56.010424 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:56.010905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:56.011346 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:56.012036 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:56.014518 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:56.015859 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:56.032069 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 HTTP/1.1 Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:50:56.033691 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:56.035202 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '8e50a3a7-1505-482c-ba59-15edb7400d06'} Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:56.036060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:56.037446 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:56.038631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:56.038631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-67e1b947-b69c-4db7-8fc8-ddbd1631c142 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 404 len: 111 microversion: 2.1 time: 0.036346 Sep 19 15:50:56.038631 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1197/2507] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:55 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:56.044100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-72337952-a431-4c11-a5c9-071998589a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '.version_select at 0x7f41fb01f160>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:56.116729 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-72337952-a431-4c11-a5c9-071998589a25 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425948516" status: 202 len: 0 microversion: 2.1 time: 0.076468 Sep 19 15:50:56.117293 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1311/2508] 10.222.0.75 () {58 vars in 1221 bytes} [Mon Sep 19 15:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425948516 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:50:58.134376 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:58.134900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:58.141760 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:58.142208 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:58.142650 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:58.143344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:58.143800 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:58.144233 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:58.157848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 HTTP/1.1 Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:50:58.159438 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.160773 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '8e50a3a7-1505-482c-ba59-15edb7400d06'} Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:58.161685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.163060 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.164671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:58.164671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3f1ea225-833c-4087-a75f-a3c7d0be83fc tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 404 len: 111 microversion: 2.1 time: 0.030355 Sep 19 15:50:58.164671 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1198/2509] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:58 2022] DELETE /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:58.170885 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:58.171498 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 8e50a3a7-1505-482c-ba59-15edb7400d06] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:58.178013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:58.178492 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:58.178927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:58.179611 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:58.180060 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:58.180535 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:58.195241 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 HTTP/1.1 Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:50:58.196907 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.198307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '8e50a3a7-1505-482c-ba59-15edb7400d06'} Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:58.199093 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. Sep 19 15:50:58.200736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:58.204368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 8e50a3a7-1505-482c-ba59-15edb7400d06 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:58.204368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-75a6e050-2238-451e-b3e8-1820174e197e tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06" status: 404 len: 111 microversion: 2.1 time: 0.032788 Sep 19 15:50:58.204368 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1312/2510] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:58 2022] GET /compute/v2.1/servers/8e50a3a7-1505-482c-ba59-15edb7400d06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:59.449567 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:59.450193 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:59.456504 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.456990 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.457420 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.458105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.458555 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.458975 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.472256 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 HTTP/1.1 Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:50:59.473877 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.475274 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '6166990c-0852-41cb-bb42-9ea385160606'} Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:59.475991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.477575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.478888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:59.478888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-7a22c767-4bf4-4f6a-8be9-2bf861314519 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 404 len: 111 microversion: 2.1 time: 0.029509 Sep 19 15:50:59.478888 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1199/2511] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:59 2022] DELETE /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:59.484252 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:59.485217 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 6166990c-0852-41cb-bb42-9ea385160606] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:59.492236 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.493758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.493758 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.493946 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.494331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.494748 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.509968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 HTTP/1.1 Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:50:59.511542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.512992 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '6166990c-0852-41cb-bb42-9ea385160606'} Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:59.513806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. Sep 19 15:50:59.514826 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.516007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 6166990c-0852-41cb-bb42-9ea385160606 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:59.516007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-9cfc276f-3f96-4a1c-821d-0811cdb3a95f tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606" status: 404 len: 111 microversion: 2.1 time: 0.033228 Sep 19 15:50:59.516007 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1313/2512] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:59 2022] GET /compute/v2.1/servers/6166990c-0852-41cb-bb42-9ea385160606 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:50:59.521951 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:59.522453 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:59.528366 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.528880 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.529319 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.530019 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.530473 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.530896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.544904 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 HTTP/1.1 Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:50:59.546454 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.547857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '472c71ee-5670-4562-bfac-24f97b292419'} Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:59.548684 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.549900 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.551243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:59.551243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-353b1c23-5760-4855-9d0b-729574601927 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 404 len: 111 microversion: 2.1 time: 0.029849 Sep 19 15:50:59.551243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1200/2513] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:50:59 2022] DELETE /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:50:59.556372 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:50:59.557035 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 472c71ee-5670-4562-bfac-24f97b292419] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:50:59.563811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.564294 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.564768 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.565462 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:50:59.565919 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:50:59.566362 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 HTTP/1.1 Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:50:59.585665 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.587237 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '472c71ee-5670-4562-bfac-24f97b292419'} Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:50:59.588053 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. Sep 19 15:50:59.589409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:50:59.591549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 472c71ee-5670-4562-bfac-24f97b292419 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:50:59.591549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-5eaf18ec-b06c-4bf4-b2f1-a7921055fe2c tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419" status: 404 len: 111 microversion: 2.1 time: 0.030794 Sep 19 15:50:59.591549 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1314/2514] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:50:59 2022] GET /compute/v2.1/servers/472c71ee-5670-4562-bfac-24f97b292419 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:00.823869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:00.824395 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:00.831478 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.831964 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.832434 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.833159 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.833614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.834044 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.847969 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 HTTP/1.1 Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:51:00.849549 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.850896 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '2751262b-7323-4c6a-b3f1-830fb2448558'} Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:00.851685 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.853114 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.854360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:00.854360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-0727779c-c9d5-4de2-9462-4c81bf90a7d3 tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 404 len: 111 microversion: 2.1 time: 0.031023 Sep 19 15:51:00.854360 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1201/2515] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:51:00 2022] DELETE /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:00.862301 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:00.862927 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] [instance: 2751262b-7323-4c6a-b3f1-830fb2448558] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:00.870190 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.870671 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.871103 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.871821 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:00.872274 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:00.872736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:00.886194 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] HTTP exception thrown: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Request method failure captured: Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 HTTP/1.1 Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKIY9-aFid3P1EHalG4h1UIv8SX0gm67sJOC0ZIwLWsrD3bnSoBTqkuljknNyGij6yCJDCXYSfjlrXz197SM5iMVkWfHgy448Jsoh4V0dbjNJhWBpNOfhax1qe8yX2ifUdvXrkj9ZS4oiwTmCfkqR2hGE9FSxeVFn-VyTNR4Zff4Bid8 Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:51:00.888254 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/13d5af34cdc54fd8be3b076c629e2cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_13d5af34cdc54fd8be3b076c629e2cbd"}]}] Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: 13d5af34cdc54fd8be3b076c629e2cbd Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-392117955 Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: fb7200a9769b46b3a79c9fe6287a1724 Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-AttachVolumeNegativeTest-392117955-project Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.889734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': '2751262b-7323-4c6a-b3f1-830fb2448558'} Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:00.890774 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. Sep 19 15:51:00.892051 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:00.893242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] Returning 404 to user: Instance 2751262b-7323-4c6a-b3f1-830fb2448558 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:00.893242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-e3831521-1244-47b3-b1b0-69f6e832128d tempest-AttachVolumeNegativeTest-392117955 tempest-AttachVolumeNegativeTest-392117955-project] 10.222.0.75 "GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558" status: 404 len: 111 microversion: 2.1 time: 0.033079 Sep 19 15:51:00.893242 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1315/2516] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:00 2022] GET /compute/v2.1/servers/2751262b-7323-4c6a-b3f1-830fb2448558 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:08.268716 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ac017e6e-d296-4dd3-a583-9cb3987c1024 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb3983a0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:08.317086 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ac017e6e-d296-4dd3-a583-9cb3987c1024 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/299abbd5-22cf-448c-9cc8-fffe335ae9ae" status: 200 len: 351 microversion: 2.1 time: 0.051673 Sep 19 15:51:08.317663 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1202/2517] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:51:08 2022] GET /compute/v2.1/os-volumes/299abbd5-22cf-448c-9cc8-fffe335ae9ae => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:09.938935 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-db803d87-019f-4dbe-a7f8-6142d090fff9 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41feb61c10>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:09.986727 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-db803d87-019f-4dbe-a7f8-6142d090fff9 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/51dc0208-adfc-4088-8113-3db50606ffbc" status: 200 len: 351 microversion: 2.1 time: 0.051849 Sep 19 15:51:09.987280 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1316/2518] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:51:09 2022] GET /compute/v2.1/os-volumes/51dc0208-adfc-4088-8113-3db50606ffbc => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:11.629690 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:11.632994 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=48,nova_cell1:INSERT=2 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:11.634386 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-3988b9d1-5ff9-46ee-a203-140e6692a031 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb4381f0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:11.684999 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-3988b9d1-5ff9-46ee-a203-140e6692a031 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8e15b9c3-84ea-4479-b1ac-089444a9ba9a" status: 200 len: 350 microversion: 2.1 time: 0.056480 Sep 19 15:51:11.685612 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1203/2519] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:51:11 2022] GET /compute/v2.1/os-volumes/8e15b9c3-84ea-4479-b1ac-089444a9ba9a => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:11.697843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:11.698620 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:51:11.703575 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1abb0621-4958-48fc-b6a1-0715a5202090 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41febe3d30>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:11.788843 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1abb0621-4958-48fc-b6a1-0715a5202090 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091722 Sep 19 15:51:11.789409 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1317/2520] 10.222.0.75 () {58 vars in 1134 bytes} [Mon Sep 19 15:51:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:51:11.803704 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f122bd97-f3cb-4677-8f68-9905e6dcff33 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb596430>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:11.885180 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f122bd97-f3cb-4677-8f68-9905e6dcff33 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085209 Sep 19 15:51:11.885772 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1204/2521] 10.222.0.75 () {58 vars in 1149 bytes} [Mon Sep 19 15:51:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:11.900059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-cf5f12b3-8911-49e4-b0c0-2fd09e142fdd tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb02fa60>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:11.987048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-cf5f12b3-8911-49e4-b0c0-2fd09e142fdd tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088337 Sep 19 15:51:11.987048 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1318/2522] 10.222.0.75 () {58 vars in 1134 bytes} [Mon Sep 19 15:51:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:11.999892 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-6b6c583c-af77-4c86-a75d-2c6f96f516ee tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb3eb040>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:12.082689 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-6b6c583c-af77-4c86-a75d-2c6f96f516ee tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087768 Sep 19 15:51:12.083253 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1205/2523] 10.222.0.75 () {58 vars in 1167 bytes} [Mon Sep 19 15:51:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:12.097956 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a89889d3-7fe0-486f-9673-1b33fb3375ad tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb07c4c0>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:12.184578 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a89889d3-7fe0-486f-9673-1b33fb3375ad tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091231 Sep 19 15:51:12.185150 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1319/2524] 10.222.0.75 () {58 vars in 1170 bytes} [Mon Sep 19 15:51:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:12.199404 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b6f107c5-8c05-4c56-b786-6ed583972126 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb2e6ee0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:12.280953 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b6f107c5-8c05-4c56-b786-6ed583972126 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085193 Sep 19 15:51:12.281606 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1206/2525] 10.222.0.75 () {58 vars in 1155 bytes} [Mon Sep 19 15:51:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:12.294811 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-ca7f28f5-7734-4af2-855e-b3d745d1eb38 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41feb5e280>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:12.375680 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-ca7f28f5-7734-4af2-855e-b3d745d1eb38 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084583 Sep 19 15:51:12.376246 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1320/2526] 10.222.0.75 () {58 vars in 1188 bytes} [Mon Sep 19 15:51:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:51:12.389524 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-89f4960d-3d21-4701-9a9d-d0a13f9496c4 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] Calling method '.version_select at 0x7f41fb2e6b80>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:12.471869 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-89f4960d-3d21-4701-9a9d-d0a13f9496c4 tempest-VolumesTestJSON-766387163 tempest-VolumesTestJSON-766387163-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086163 Sep 19 15:51:12.472467 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1207/2527] 10.222.0.75 () {58 vars in 1155 bytes} [Mon Sep 19 15:51:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:18.399632 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-289a5dfe-7658-403a-90cb-223b0d5ed355 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Action: 'create', calling method: .version_select at 0x7f41fb01f1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1370557549", "metadata": {"Type": "work"}}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-289a5dfe-7658-403a-90cb-223b0d5ed355 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Request method failure captured: Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 122 Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI_29kDPf5Xax9LueWGHVdTtBws8RgdXeuHt2yXIRaLWZllDve09DeOxO9lMCisEaCWaywwScqPBiMFjaKWFGRQVBEfOzu7VxRXFIKjVD25SXOPPjhE1OlGsbtNAEE7419uucfbRTo28gIw0H0gdNAkVfkO7g1nAMlpYJ2MxZthRHIU Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:51:18.411021 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcd067011e75458a85cbae4d2a2cd8e8"}]}] Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 8f3068c37e174f84a83fd7f1e8b1e29b Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1370557549", "metadata": {"Type": "work"}}} Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: Sep 19 15:51:18.412556 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1370557549', 'metadata': {'Type': 'work'}}}} Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:18.413557 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:51:18.415084 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:51:18.416373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 15:51:18.416373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.416373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-289a5dfe-7658-403a-90cb-223b0d5ed355 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:18.416373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-289a5dfe-7658-403a-90cb-223b0d5ed355 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.126198 Sep 19 15:51:18.416373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1321/2528] 10.222.0.75 () {60 vars in 1156 bytes} [Mon Sep 19 15:51:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:51:18.422775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc501cb7-2401-4a78-a4fd-75aef41d9226 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Action: 'create', calling method: .version_select at 0x7f41fb39aca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-606666347", "metadata": {"Type": "work"}}} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc501cb7-2401-4a78-a4fd-75aef41d9226 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Request method failure captured: Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 119 Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKI_29kDPf5Xax9LueWGHVdTtBws8RgdXeuHt2yXIRaLWZllDve09DeOxO9lMCisEaCWaywwScqPBiMFjaKWFGRQVBEfOzu7VxRXFIKjVD25SXOPPjhE1OlGsbtNAEE7419uucfbRTo28gIw0H0gdNAkVfkO7g1nAMlpYJ2MxZthRHIU Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:51:18.427344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcd067011e75458a85cbae4d2a2cd8e8"}]}] Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 8f3068c37e174f84a83fd7f1e8b1e29b Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-606666347", "metadata": {"Type": "work"}}} Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: Sep 19 15:51:18.428826 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-606666347', 'metadata': {'Type': 'work'}}}} Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi '0' Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:18.429673 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:51:18.431095 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:51:18.432402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 15:51:18.432402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.432402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-bc501cb7-2401-4a78-a4fd-75aef41d9226 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:18.432402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-bc501cb7-2401-4a78-a4fd-75aef41d9226 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010543 Sep 19 15:51:18.432402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1208/2529] 10.222.0.75 () {60 vars in 1156 bytes} [Mon Sep 19 15:51:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a6ab9287-3704-4915-b863-1d71d2952cb8 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Action: 'create', calling method: .version_select at 0x7f41febd7310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-910716080", "metadata": {"Type": "work"}}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a6ab9287-3704-4915-b863-1d71d2952cb8 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Request method failure captured: Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 118 Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI_29kDPf5Xax9LueWGHVdTtBws8RgdXeuHt2yXIRaLWZllDve09DeOxO9lMCisEaCWaywwScqPBiMFjaKWFGRQVBEfOzu7VxRXFIKjVD25SXOPPjhE1OlGsbtNAEE7419uucfbRTo28gIw0H0gdNAkVfkO7g1nAMlpYJ2MxZthRHIU Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:51:18.449985 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcd067011e75458a85cbae4d2a2cd8e8"}]}] Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 8f3068c37e174f84a83fd7f1e8b1e29b Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-910716080", "metadata": {"Type": "work"}}} Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: Sep 19 15:51:18.452164 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-910716080', 'metadata': {'Type': 'work'}}}} Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise error Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi '' Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:18.453118 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 15:51:18.454515 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 15:51:18.455706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 15:51:18.455706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.455706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a6ab9287-3704-4915-b863-1d71d2952cb8 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:18.455706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a6ab9287-3704-4915-b863-1d71d2952cb8 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010089 Sep 19 15:51:18.455706 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1322/2530] 10.222.0.75 () {60 vars in 1156 bytes} [Mon Sep 19 15:51:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 15:51:18.458857 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e7fe4d3-f06c-4346-b168-77850da99e8a tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Calling method '.version_select at 0x7f41fb40bee0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:18.487505 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-8e7fe4d3-f06c-4346-b168-77850da99e8a tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] HTTP exception thrown: Volume tempest-invalid-1253604650 could not be found. Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e7fe4d3-f06c-4346-b168-77850da99e8a tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Request method failure captured: Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1253604650 HTTP/1.1 Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKI_29kDPf5Xax9LueWGHVdTtBws8RgdXeuHt2yXIRaLWZllDve09DeOxO9lMCisEaCWaywwScqPBiMFjaKWFGRQVBEfOzu7VxRXFIKjVD25SXOPPjhE1OlGsbtNAEE7419uucfbRTo28gIw0H0gdNAkVfkO7g1nAMlpYJ2MxZthRHIU Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:51:18.489492 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcd067011e75458a85cbae4d2a2cd8e8"}]}] Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 8f3068c37e174f84a83fd7f1e8b1e29b Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Volume tempest-invalid-1253604650 could not be found. Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': 'tempest-invalid-1253604650'} Sep 19 15:51:18.490919 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1253604650 could not be found. (HTTP 404) (Request-ID: req-fc455075-d11e-4695-ac46-e6f59cfd170f) Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.491834 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:51:18.493222 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1253604650 could not be found. Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:18.494371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1253604650 could not be found. Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1253604650 could not be found. Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8e7fe4d3-f06c-4346-b168-77850da99e8a tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Returning 404 to user: Volume tempest-invalid-1253604650 could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8e7fe4d3-f06c-4346-b168-77850da99e8a tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1253604650" status: 404 len: 99 microversion: 2.1 time: 0.036393 Sep 19 15:51:18.495682 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1209/2531] 10.222.0.75 () {58 vars in 1218 bytes} [Mon Sep 19 15:51:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1253604650 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 15:51:18.500623 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-b107b190-3478-418e-ba69-e04fd51d6822 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004069 Sep 19 15:51:18.501114 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1323/2532] 10.222.0.75 () {58 vars in 1140 bytes} [Mon Sep 19 15:51:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 15:51:18.509015 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-110e35dd-1c4c-43dd-9618-ac28419a93e1 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003495 Sep 19 15:51:18.509503 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1210/2533] 10.222.0.75 () {58 vars in 1137 bytes} [Mon Sep 19 15:51:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 15:51:18.521206 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0050e869-eb6b-4cc4-b72f-f33c2ebcf223 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Calling method '.version_select at 0x7f41febe3940>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:18.550496 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-0050e869-eb6b-4cc4-b72f-f33c2ebcf223 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] HTTP exception thrown: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0050e869-eb6b-4cc4-b72f-f33c2ebcf223 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Request method failure captured: Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: DELETE /compute/v2.1/os-volumes/bb222a8e-bb44-4d4f-8fb4-e3080801037e HTTP/1.1 Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI_29kDPf5Xax9LueWGHVdTtBws8RgdXeuHt2yXIRaLWZllDve09DeOxO9lMCisEaCWaywwScqPBiMFjaKWFGRQVBEfOzu7VxRXFIKjVD25SXOPPjhE1OlGsbtNAEE7419uucfbRTo28gIw0H0gdNAkVfkO7g1nAMlpYJ2MxZthRHIU Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:51:18.552542 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcd067011e75458a85cbae4d2a2cd8e8"}]}] Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: 8f3068c37e174f84a83fd7f1e8b1e29b Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'bb222a8e-bb44-4d4f-8fb4-e3080801037e'} Sep 19 15:51:18.554043 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. (HTTP 404) (Request-ID: req-8c7caaac-a005-4de8-9202-7669b22a5480) Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.554923 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 15:51:18.556116 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 15:51:18.557273 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-0050e869-eb6b-4cc4-b72f-f33c2ebcf223 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Returning 404 to user: Volume bb222a8e-bb44-4d4f-8fb4-e3080801037e could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-0050e869-eb6b-4cc4-b72f-f33c2ebcf223 tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/bb222a8e-bb44-4d4f-8fb4-e3080801037e" status: 404 len: 109 microversion: 2.1 time: 0.036395 Sep 19 15:51:18.558330 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1324/2534] 10.222.0.75 () {58 vars in 1248 bytes} [Mon Sep 19 15:51:18 2022] DELETE /compute/v2.1/os-volumes/bb222a8e-bb44-4d4f-8fb4-e3080801037e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:18.563536 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-632953e8-170b-4b48-80e9-921560e1577d tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Calling method '.version_select at 0x7f41fb2f40d0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:18.590827 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-632953e8-170b-4b48-80e9-921560e1577d tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] HTTP exception thrown: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-632953e8-170b-4b48-80e9-921560e1577d tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Request method failure captured: Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: GET /compute/v2.1/os-volumes/49aaf033-7be7-4853-ad8d-b1a1aeda5efa HTTP/1.1 Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKI_29kDPf5Xax9LueWGHVdTtBws8RgdXeuHt2yXIRaLWZllDve09DeOxO9lMCisEaCWaywwScqPBiMFjaKWFGRQVBEfOzu7VxRXFIKjVD25SXOPPjhE1OlGsbtNAEE7419uucfbRTo28gIw0H0gdNAkVfkO7g1nAMlpYJ2MxZthRHIU Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:51:18.593190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dcd067011e75458a85cbae4d2a2cd8e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dcd067011e75458a85cbae4d2a2cd8e8"}]}] Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: dcd067011e75458a85cbae4d2a2cd8e8 Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-VolumesNegativeTest-1329538668 Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: 8f3068c37e174f84a83fd7f1e8b1e29b Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-VolumesNegativeTest-1329538668-project Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'id': '49aaf033-7be7-4853-ad8d-b1a1aeda5efa'} Sep 19 15:51:18.594566 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. (HTTP 404) (Request-ID: req-b2230511-0e61-4837-9a5e-7a40a4dc0dea) Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.595371 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 15:51:18.596637 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 15:51:18.597842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-632953e8-170b-4b48-80e9-921560e1577d tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] Returning 404 to user: Volume 49aaf033-7be7-4853-ad8d-b1a1aeda5efa could not be found. {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-632953e8-170b-4b48-80e9-921560e1577d tempest-VolumesNegativeTest-1329538668 tempest-VolumesNegativeTest-1329538668-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/49aaf033-7be7-4853-ad8d-b1a1aeda5efa" status: 404 len: 109 microversion: 2.1 time: 0.034899 Sep 19 15:51:18.599175 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1211/2535] 10.222.0.75 () {58 vars in 1245 bytes} [Mon Sep 19 15:51:18 2022] GET /compute/v2.1/os-volumes/49aaf033-7be7-4853-ad8d-b1a1aeda5efa => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:51:48.073328 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:51:48.075591 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:48.082833 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:48.087348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:48.087348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:48.087348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:48.087348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:48.087685 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:48.290333 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-6d1f4308-3e18-46a6-9cc9-33dd4113bc25 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/action" status: 202 len: 0 microversion: 2.1 time: 0.222759 Sep 19 15:51:48.290862 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1325/2536] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:51:48 2022] POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:51:48.309559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:48.310178 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:48.327848 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:48.328264 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:48.328725 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:48.329440 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:48.329887 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:48.330305 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:48.558324 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:48.567344 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-54d88361-4db6-4866-b885-41594d15cf3a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1752 microversion: 2.1 time: 0.271537 Sep 19 15:51:48.567944 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1212/2537] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:48 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:49.591908 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:49.592692 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:49.599310 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:49.599787 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:49.600226 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:49.600950 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:49.601407 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:49.601848 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:49.745538 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:49.754906 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7a6f33c2-65cc-4bcc-a82a-d07412d3500c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.167135 Sep 19 15:51:49.755487 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1326/2538] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:49 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:50.778986 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:50.779607 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:50.786227 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:50.786710 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:50.787148 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:50.788390 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:50.788868 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:50.789295 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:50.929829 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:50.937921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-eb7f5eb6-97ff-42d2-a4b8-0313ec4d4905 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.162809 Sep 19 15:51:50.938477 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1213/2539] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:50 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:51.962068 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:51.962756 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:51.969197 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:51.969709 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:51.970154 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:51.970872 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:51.971327 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:51.971793 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:52.117968 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:52.126181 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-a4b26768-8269-4469-9f10-3d917455fd8c tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.168030 Sep 19 15:51:52.126742 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1327/2540] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:51 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:53.150614 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:53.151238 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:53.157636 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:53.158121 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:53.158558 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:53.159402 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:53.159976 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:53.160413 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:53.300335 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:53.308421 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-f6f7c334-f4a5-40bf-b549-776f508cf613 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.161697 Sep 19 15:51:53.309005 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1214/2541] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:53 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:54.333230 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:54.333860 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:54.340307 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:54.340816 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:54.341247 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:54.341932 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:54.342380 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:54.342806 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:54.493322 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:54.501584 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1221381b-a89b-4ed3-847a-5db92c69bba5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.173522 Sep 19 15:51:54.502144 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1328/2542] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:54 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:55.524830 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:55.525486 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:55.531955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:55.532439 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:55.532908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:55.533602 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:55.534058 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:55.534509 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:55.929618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:55.938031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b8456a75-16ae-4b11-b00a-03f67f3ea1ee tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.417221 Sep 19 15:51:55.938596 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1215/2543] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:55 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:51:56.962401 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:56.963071 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:56.969545 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:56.970030 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:56.970474 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:56.971168 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:56.971625 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:56.972195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:57.119006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:57.127448 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7a88d564-7498-4255-b11b-7b727eb172c2 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.168942 Sep 19 15:51:57.128577 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1329/2544] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:56 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:58.152908 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:58.153559 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:58.161521 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:58.162104 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:58.162552 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:58.163268 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:58.163728 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:58.164160 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:58.311409 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:58.321991 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-8781c7a4-057a-4a6d-bcd3-f198028a3ae4 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.173419 Sep 19 15:51:58.327280 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1216/2545] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:58 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:51:59.350782 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:51:59.351387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:51:59.357875 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:59.358352 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:59.358783 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:59.359468 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:51:59.359917 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:51:59.360339 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:51:59.505805 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:51:59.514096 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-06175ddb-90b5-44f5-a347-214390b643db tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1757 microversion: 2.1 time: 0.167932 Sep 19 15:51:59.514655 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1330/2546] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:51:59 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:00.539247 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:00.539993 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:00.546640 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:00.547120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:00.547550 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:00.548237 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:00.548717 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:00.549140 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:00.695618 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:52:00.703849 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-73b8cb50-a8ef-42df-b9a0-3f5f6d050cbe tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1760 microversion: 2.1 time: 0.169487 Sep 19 15:52:00.704407 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1217/2547] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:52:00 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:52:56.911649 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1693805130"}} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:56.912267 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:56.914331 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_api:SELECT=12 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:56.915617 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG dbcounter [-] [121178] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:56.920550 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:56.923616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:56.923616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:56.923616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:56.923616 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:56.925006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:57.058186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.network.security_group_api [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Removing security group c5d3d474-7da4-4e69-9c42-52c5c13efb2b from port f5fa2195-4ec0-4ed6-9dca-08155365f6ed Sep 19 15:52:57.428403 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-caee4745-13cb-489b-af99-2feb89b9b366 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/action" status: 202 len: 0 microversion: 2.1 time: 0.520778 Sep 19 15:52:57.434592 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1331/2548] 10.222.0.75 () {60 vars in 1278 bytes} [Mon Sep 19 15:52:56 2022] POST /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:52:57.441941 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-798609d8-eef4-4907-b22c-4cd1fcd9839b req-b8455744-4007-46f3-8da5-37f543d2150a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:57.451996 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_api:SELECT=12 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:57.452955 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG dbcounter [-] [121177] Writing DB stats nova_cell1:SELECT=36 {{(pid=121177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:52:57.454943 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-798609d8-eef4-4907-b22c-4cd1fcd9839b req-b8455744-4007-46f3-8da5-37f543d2150a service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:57.455457 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-798609d8-eef4-4907-b22c-4cd1fcd9839b req-b8455744-4007-46f3-8da5-37f543d2150a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:57.455956 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-798609d8-eef4-4907-b22c-4cd1fcd9839b req-b8455744-4007-46f3-8da5-37f543d2150a service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:57.468840 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-798609d8-eef4-4907-b22c-4cd1fcd9839b req-b8455744-4007-46f3-8da5-37f543d2150a service nova] Creating event network-changed:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:52:57.475040 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-798609d8-eef4-4907-b22c-4cd1fcd9839b req-b8455744-4007-46f3-8da5-37f543d2150a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036627 Sep 19 15:52:57.478665 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1218/2549] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:52:58.651497 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:58.652013 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:58.656035 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [req-350d384b-3ee7-40fc-bb75-6b3ba2e5ffa4 req-c3dd724f-668e-43de-a41e-6d5eccde48e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:52:58.658081 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:58.658565 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:58.659006 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:58.659702 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:58.660152 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:58.660794 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:58.667570 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-350d384b-3ee7-40fc-bb75-6b3ba2e5ffa4 req-c3dd724f-668e-43de-a41e-6d5eccde48e6 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:58.668126 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-350d384b-3ee7-40fc-bb75-6b3ba2e5ffa4 req-c3dd724f-668e-43de-a41e-6d5eccde48e6 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:58.668966 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [req-350d384b-3ee7-40fc-bb75-6b3ba2e5ffa4 req-c3dd724f-668e-43de-a41e-6d5eccde48e6 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:58.680134 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.compute.server_external_events [req-350d384b-3ee7-40fc-bb75-6b3ba2e5ffa4 req-c3dd724f-668e-43de-a41e-6d5eccde48e6 service nova] Creating event network-changed:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:52:58.685102 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [req-350d384b-3ee7-40fc-bb75-6b3ba2e5ffa4 req-c3dd724f-668e-43de-a41e-6d5eccde48e6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034422 Sep 19 15:52:58.686109 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1219/2550] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:52:58.761801 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.objects.instance [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lazy-loading 'services' on Instance uuid d4090506-4631-4c52-a4e1-d33254719569 {{(pid=121178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:52:59.007218 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-135ef56c-b838-4f20-b1f1-750f3e4c8f2a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments/d4fef7f3-a480-4d84-b820-1264d9dea96f" status: 202 len: 0 microversion: 2.1 time: 0.360441 Sep 19 15:52:59.009148 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1332/2551] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:52:58 2022] DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments/d4fef7f3-a480-4d84-b820-1264d9dea96f => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 15:52:59.021190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:52:59.024765 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:52:59.031442 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:59.031926 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:59.032597 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:59.033575 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:52:59.034260 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:52:59.034687 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:52:59.064905 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-ebc7de74-be28-4911-8b30-97e33e496aa8 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051613 Sep 19 15:52:59.065469 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1220/2552] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:52:59 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:00.081419 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:00.084186 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:00.094323 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:00.094844 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:00.095284 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:00.096018 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:00.096522 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:00.096952 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:00.142902 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-90152d84-0a42-4015-b822-551b8dd104d7 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066261 Sep 19 15:53:00.143502 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1333/2553] 10.222.0.75 () {58 vars in 1302 bytes} [Mon Sep 19 15:53:00 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 15:53:00.155108 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:00.155661 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:00.162190 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:00.162677 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:00.163112 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:00.163801 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:00.164255 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:00.164875 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:00.251031 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.wsgi [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] HTTP exception thrown: Instance d4090506-4631-4c52-a4e1-d33254719569 is not attached to volume d4fef7f3-a480-4d84-b820-1264d9dea96f Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Request method failure captured: Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: request: DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments/d4fef7f3-a480-4d84-b820-1264d9dea96f HTTP/1.1 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept: application/json Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Accept-Encoding: identity Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Connection: close Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Length: 0 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Content-Type: application/json Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Host: 10.222.0.75 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: Openstack-System-Scope: None Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: User-Agent: python-urllib3/1.26.12 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Auth-Token: gAAAAABjKI-ZS3lwdxWC_NoBd6cGIM_QgLe51savlCVVQduvxEpmSYsf4-EBNZ4UtLdug9g_TA7oRvs4c-1hkXqN1Gjs1NzCNLlvqN0HkXMC6Y6Nri2P5ti34yPfu8x3EMcrId-2NdAAlzfzrWn2g5lwBE_gP_eVK5iZJn3Yr5uZZhQaHCkS3t8 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Id: None Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Domain-Name: None Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Identity-Status: Confirmed Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Is-Admin-Project: True Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Id: default Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Domain-Name: Default Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Id: abac9835b5dd48248ba4f7d77ea8d7f5 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Project-Name: tempest-TestMinimumBasicScenario-1635817015 Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Role: member,reader Sep 19 15:53:00.258289 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Roles: member,reader Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/abac9835b5dd48248ba4f7d77ea8d7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/abac9835b5dd48248ba4f7d77ea8d7f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/abac9835b5dd48248ba4f7d77ea8d7f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_abac9835b5dd48248ba4f7d77ea8d7f5"}]}] Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant: tempest-TestMinimumBasicScenario-1635817015 Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Id: abac9835b5dd48248ba4f7d77ea8d7f5 Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1635817015 Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User: tempest-TestMinimumBasicScenario-1635817015-project Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Id: default Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Domain-Name: Default Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Id: a4a0d76fa5a54a729b0e4862a6c88de7 Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: X-User-Name: tempest-TestMinimumBasicScenario-1635817015-project Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: method: > Sep 19 15:53:00.260299 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: exception: Instance d4090506-4631-4c52-a4e1-d33254719569 is not attached to volume d4fef7f3-a480-4d84-b820-1264d9dea96f Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: action_args: {'server_id': 'd4090506-4631-4c52-a4e1-d33254719569', 'id': 'd4fef7f3-a480-4d84-b820-1264d9dea96f'} Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d4fef7f3-a480-4d84-b820-1264d9dea96f. Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:53:00.261118 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4090506-4631-4c52-a4e1-d33254719569 is not attached to volume d4fef7f3-a480-4d84-b820-1264d9dea96f Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4090506-4631-4c52-a4e1-d33254719569 is not attached to volume d4fef7f3-a480-4d84-b820-1264d9dea96f Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR nova.api.openstack.wsgi Sep 19 15:53:00.264018 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Returning 404 to user: Instance d4090506-4631-4c52-a4e1-d33254719569 is not attached to volume d4fef7f3-a480-4d84-b820-1264d9dea96f {{(pid=121177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:53:00.266120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-75951d2a-8015-4734-ba81-1f252a7cfcc5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments/d4fef7f3-a480-4d84-b820-1264d9dea96f" status: 404 len: 154 microversion: 2.1 time: 0.105030 Sep 19 15:53:00.266120 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1221/2554] 10.222.0.75 () {58 vars in 1416 bytes} [Mon Sep 19 15:53:00 2022] DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569/os-volume_attachments/d4fef7f3-a480-4d84-b820-1264d9dea96f => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:53:01.562614 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:01.563100 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:01.569413 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:01.569894 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:01.570326 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:01.571613 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:01.572059 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:01.572511 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:01.597428 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Going to try to terminate instance {{(pid=121178) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:53:01.934841 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-08f1fb94-80b6-43bf-8e37-0513ee2c570e tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 204 len: 0 microversion: 2.1 time: 0.375172 Sep 19 15:53:01.935523 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1334/2555] 10.222.0.75 () {58 vars in 1239 bytes} [Mon Sep 19 15:53:01 2022] DELETE /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:53:01.945243 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:01.946545 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:01.954592 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:01.955223 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:01.955799 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:01.956750 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:01.957353 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:01.957921 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:02.109403 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:02.122429 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-5b993119-11c3-4194-932a-9648e8a5e2e5 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1554 microversion: 2.1 time: 0.182061 Sep 19 15:53:02.123426 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1222/2556] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:01 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:03.162373 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:03.163073 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:03.170292 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:03.170778 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:03.171209 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:03.171895 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:03.172348 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:03.172800 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:03.306734 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.policy [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121178) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:03.314495 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-1b7709d9-7552-4ebf-8da7-5ed2440f943a tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1554 microversion: 2.1 time: 0.156425 Sep 19 15:53:03.315050 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1335/2557] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:03 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:04.338538 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:04.339215 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:04.345527 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:04.346014 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:04.346449 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:04.347149 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:04.347605 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:04.348032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:04.547499 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:04.557633 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-65509bf9-c242-4cf5-b3a9-1028dcb0ffe9 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1554 microversion: 2.1 time: 0.223065 Sep 19 15:53:04.564668 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1223/2558] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:04 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:53:04.710705 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [req-bb55e4f8-4e86-412d-bf85-41e6b5de3b0c req-3075b000-c2e3-48c5-8325-c020f56f8461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4090506-4631-4c52-a4e1-d33254719569", "name": "network-vif-deleted", "tag": "f5fa2195-4ec0-4ed6-9dca-08155365f6ed"}]} {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:53:04.729042 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-bb55e4f8-4e86-412d-bf85-41e6b5de3b0c req-3075b000-c2e3-48c5-8325-c020f56f8461 service nova] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:04.729944 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-bb55e4f8-4e86-412d-bf85-41e6b5de3b0c req-3075b000-c2e3-48c5-8325-c020f56f8461 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:04.730825 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [req-bb55e4f8-4e86-412d-bf85-41e6b5de3b0c req-3075b000-c2e3-48c5-8325-c020f56f8461 service nova] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:04.750765 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.compute.server_external_events [req-bb55e4f8-4e86-412d-bf85-41e6b5de3b0c req-3075b000-c2e3-48c5-8325-c020f56f8461 service nova] Creating event network-vif-deleted:f5fa2195-4ec0-4ed6-9dca-08155365f6ed for instance d4090506-4631-4c52-a4e1-d33254719569 on hv-cinder-75671 Sep 19 15:53:04.759639 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [req-bb55e4f8-4e86-412d-bf85-41e6b5de3b0c req-3075b000-c2e3-48c5-8325-c020f56f8461 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056081 Sep 19 15:53:04.762827 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1336/2559] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Sep 19 15:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:53:05.584925 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:05.585546 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.compute.api [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121177) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:05.596842 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:05.597775 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:05.598617 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:05.599954 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:05.600907 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:05.601737 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:05.643277 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:05.643666 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:05.644100 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG oslo_concurrency.lockutils [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:05.645531 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.objects.instance [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lazy-loading 'fault' on Instance uuid d4090506-4631-4c52-a4e1-d33254719569 {{(pid=121177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:53:05.694415 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.policy [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a0d76fa5a54a729b0e4862a6c88de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abac9835b5dd48248ba4f7d77ea8d7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121177) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:53:05.703105 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-b8cbc8c8-cb28-4987-ac57-8d086a9d2c47 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 200 len: 1348 microversion: 2.1 time: 0.124469 Sep 19 15:53:05.703683 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1224/2560] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:05 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 1348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:53:06.731379 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '>' {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:06.733016 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.compute.api [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [instance: d4090506-4631-4c52-a4e1-d33254719569] Fetching instance by UUID {{(pid=121178) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:53:06.743736 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:06.744504 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:06.745387 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:06.746807 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Acquiring lock "9fad812d-08ce-4e89-9888-006021c91877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:53:06.747769 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:53:06.748717 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG oslo_concurrency.lockutils [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Lock "9fad812d-08ce-4e89-9888-006021c91877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:53:06.776120 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.wsgi [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] HTTP exception thrown: Instance d4090506-4631-4c52-a4e1-d33254719569 could not be found. Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Request method failure captured: Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: request: GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 HTTP/1.1 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept: application/json Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Accept-Encoding: identity Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Connection: close Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Length: 0 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Content-Type: application/json Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Host: 10.222.0.75 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: Openstack-System-Scope: None Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: User-Agent: python-urllib3/1.26.12 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Auth-Token: gAAAAABjKI-ZS3lwdxWC_NoBd6cGIM_QgLe51savlCVVQduvxEpmSYsf4-EBNZ4UtLdug9g_TA7oRvs4c-1hkXqN1Gjs1NzCNLlvqN0HkXMC6Y6Nri2P5ti34yPfu8x3EMcrId-2NdAAlzfzrWn2g5lwBE_gP_eVK5iZJn3Yr5uZZhQaHCkS3t8 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Id: None Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Domain-Name: None Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Identity-Status: Confirmed Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Is-Admin-Project: True Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Id: default Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Domain-Name: Default Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Id: abac9835b5dd48248ba4f7d77ea8d7f5 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Project-Name: tempest-TestMinimumBasicScenario-1635817015 Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Role: member,reader Sep 19 15:53:06.777881 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Roles: member,reader Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/abac9835b5dd48248ba4f7d77ea8d7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/abac9835b5dd48248ba4f7d77ea8d7f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/abac9835b5dd48248ba4f7d77ea8d7f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_abac9835b5dd48248ba4f7d77ea8d7f5"}]}] Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant: tempest-TestMinimumBasicScenario-1635817015 Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Id: abac9835b5dd48248ba4f7d77ea8d7f5 Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1635817015 Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User: tempest-TestMinimumBasicScenario-1635817015-project Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Id: default Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Domain-Name: Default Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Id: a4a0d76fa5a54a729b0e4862a6c88de7 Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: X-User-Name: tempest-TestMinimumBasicScenario-1635817015-project Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: method: > Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: exception: Instance d4090506-4631-4c52-a4e1-d33254719569 could not be found. Sep 19 15:53:06.779275 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: action_args: {'id': 'd4090506-4631-4c52-a4e1-d33254719569'} Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: {{(pid=121178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4090506-4631-4c52-a4e1-d33254719569 could not be found. Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:53:06.780318 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4090506-4631-4c52-a4e1-d33254719569 could not be found. Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4090506-4631-4c52-a4e1-d33254719569 could not be found. Sep 19 15:53:06.782195 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: ERROR nova.api.openstack.wsgi Sep 19 15:53:06.783948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: DEBUG nova.api.openstack.wsgi [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Returning 404 to user: Instance d4090506-4631-4c52-a4e1-d33254719569 could not be found. {{(pid=121178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:53:06.783948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: INFO nova.api.openstack.requestlog [None req-7f8627f0-b8b5-4d7c-860a-436656373606 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569" status: 404 len: 111 microversion: 2.1 time: 0.056184 Sep 19 15:53:06.783948 dv-cinder-756711-11-iscsi devstack@n-api.service[121178]: [pid: 121178|app: 0|req: 1337/2561] 10.222.0.75 () {58 vars in 1236 bytes} [Mon Sep 19 15:53:06 2022] GET /compute/v2.1/servers/d4090506-4631-4c52-a4e1-d33254719569 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 15:53:06.788155 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: DEBUG nova.api.openstack.wsgi [None req-65131c4c-ca1e-4e31-869d-88f66eb64356 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] Calling method '.version_select at 0x7f41fb374dc0>' {{(pid=121177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:53:06.795363 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65131c4c-ca1e-4e31-869d-88f66eb64356 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [9adc1552-bab9-44a5-a369-2c8fb7a24a88] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 15:53:07.802110 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO oslo.messaging._drivers.impl_rabbit [None req-65131c4c-ca1e-4e31-869d-88f66eb64356 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] [9adc1552-bab9-44a5-a369-2c8fb7a24a88] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 59514. Sep 19 15:53:07.871032 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: INFO nova.api.openstack.requestlog [None req-65131c4c-ca1e-4e31-869d-88f66eb64356 tempest-TestMinimumBasicScenario-1635817015 tempest-TestMinimumBasicScenario-1635817015-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-327351449" status: 202 len: 0 microversion: 2.1 time: 1.086650 Sep 19 15:53:07.871898 dv-cinder-756711-11-iscsi devstack@n-api.service[121177]: [pid: 121177|app: 0|req: 1225/2562] 10.222.0.75 () {58 vars in 1269 bytes} [Mon Sep 19 15:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-327351449 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)